anonymous user

Forums   Register   Login   Forgot your login/password?   Search

Index Size Limit

Common forum | 1 | 2 | 3 | 4 | 5 | ... | 453 | 454 | 455 | 456 | next »» | Create new thread

chobbes31

Name: Mike
Posts: 23

2009-02-11 16:55:13 | reply!

Is there any type of size restriction when doing a rotate on an index? We are suddenly
seeing some errors on index rotation.

[Wed Feb 11 09:48:26.898 2009] [ 5125] WARNING: rotating index 'forum_new_main': preread
failed: read error in /usr/var/data/sphinx/forum_new_main.new.spa; 2147479552 of
2238533052 bytes read; using old index

The index has not been modified in any way, it has just gotten larger.

Thanks
chobbes31

Name: Mike
Posts: 23

to: chobbes31, 2009-02-11 19:39:11 | reply!

> Is there any type of size restriction when doing a rotate on an index? We are suddenly
> seeing some errors on index rotation.
>
> [Wed Feb 11 09:48:26.898 2009] [ 5125] WARNING: rotating index 'forum_new_main': preread
> failed: read error in /usr/var/data/sphinx/forum_new_main.new.spa; 2147479552 of
> 2238533052 bytes read; using old index
>
> The index has not been modified in any way, it has just gotten larger.
>
> Thanks

Another quick note - we are using 9.8.1 - 64 bit release and the notes say that the
release "fixed 32-bit wraparound when preloading over 2 GB files", but we have a 64-bit
build.
Arantor

Name: Pete Spicer
Posts: 4444

to: chobbes31, 2009-02-11 23:45:32 | reply!

> Another quick note - we are using 9.8.1 - 64 bit release and the notes say that the
> release "fixed 32-bit wraparound when preloading over 2 GB files", but we have a 64-bit
> build.

The issue in question is that the file size is larger than a signed 32 bit integer, which
is the "wraparound", not the fact you're using a 64-bit build.

This is actually a limitation inherently in the underlying file tools (GLIBC, I believe)
where the read() function is implemented and has a 2GB cap.

This has been fixed in 0.9.9-rc1 - from the changelog:
* fixed .spa loading on systems where read() is 2GB capped

Common forum | 1 | 2 | 3 | 4 | 5 | ... | 453 | 454 | 455 | 456 | next »» | Create new thread