|
Sphinx
Community
Services
Misc
 Subscribe in a reader
|
Sphinx returns no results even if there is match
Common forum |
1 | 2 | 3 | 4 | 5 | ... |
273 | 274 | 275 | 276 | next »» | Create new thread
|
dilipangal
Name: Dilip Angal
Posts: 5
|
2010-07-25 18:39:04
| reply!
I noticed that for some search queries, sphinx returns no results even if there is
matching document for the query, especially under heavy load.
I am running 8 python processes each querying heavily sphinx indexes.
When I run no load, same query returns successfully. No change in index.
Any help?
|
|
dilipangal
Name: Dilip Angal
Posts: 5
|
to: dilipangal, 2010-07-25 18:42:58
| reply!
> I noticed that for some search queries, sphinx returns no results even if there is
> matching document for the query, especially under heavy load.
> I am running 8 python processes each querying heavily sphinx indexes.
>
> When I run no load, same query returns successfully. No change in index.
> Any help?
>
Further to this, search was done using extended2 mode and quorum search.
For e.g. '"xxx yyy"/2'
|
|
vladfr
Name: Vlad Fratila
Posts: 30
|
to: dilipangal, 2010-07-30 11:32:21
| reply!
Hey, did you find a fix? Just wondering... maybe it's a memory problem.
|
|
dilipangal
Name: Dilip Angal
Posts: 5
|
to: vladfr, 2010-07-30 22:28:37
| reply!
> Hey, did you find a fix? Just wondering... maybe it's a memory problem.
Nope
Don't know what is going on.
Can't be memory problem.
I have 32GB RAM on that machine and 'top' stat shows not all the memory is used.
There is plenty of free memory
Dilip
|
|
|
vladfr
Name: Vlad Fratila
Posts: 30
|
to: dilipangal, 2010-08-03 13:37:10
| reply!
> > Hey, did you find a fix? Just wondering... maybe it's a memory problem.
> Nope
> Don't know what is going on.
> Can't be memory problem.
> I have 32GB RAM on that machine and 'top' stat shows not all the memory is used.
> There is plenty of free memory
> Dilip
>
Hi,
I'm starting to get the same problem, and it's not because of memory/cpu etc.
For me, the problem seems to be with text fields.
If I search for some keywords and add 4-5 filters, searchd crashes.
I noticed that if I discard some filters on simple attributes, it works, with the same
keywords.
It started after I added a attr_multi uint with a lot of values to the index (200k, not
that much actually).
|
|
|
vladfr
Name: Vlad Fratila
Posts: 30
|
to: vladfr, 2010-08-03 14:11:02
| reply!
I have another idea:
What happens if a document doesn't have the field/attribute that I'm searching for?
e.g. I'm searching for resumes that have University Name field with zero, one or more
values. The field is a sql_joined_field.
In the join query, the documents with no value do not appear.
So in the index, there's no University field for that document.
I think every time Sphinx finds such a document (with missing fields) it crashes.
Any fixes?
|
|
|
vladfr
Name: Vlad Fratila
Posts: 30
|
to: vladfr, 2010-08-03 15:59:38
| reply!
Sorry to be replying like crazy, but I'm working on this as such :)
I only have problems with sphinx not returning rows when I use pagination.
i.e. first rows are returned, but when sphinx bumps into a "bad" document inside the
pagination interval, it fails.
Which are my "bad" documents you ask?
I have a attr_timestamp in my source.
If I delete that attr, it magically works.
What puzzles me though is that the attr value for the "bad" document is fine (it was
indexing a valid timestamp).
|
|
barryhunter
Name: Barry Hunter
Posts: 1700
|
to: vladfr, 2010-08-03 15:59:39
| reply!
If a left join doesn't get a value, will return NULL. Maybe sphinx doesnt like that. Try
coalesce() to make it 0 perhaps?
|
|
vladfr
Name: Vlad Fratila
Posts: 30
|
to: barryhunter, 2010-08-03 16:02:41
| reply!
>
> If a left join doesn't get a value, will return NULL. Maybe sphinx doesnt like that. Try
> coalesce() to make it 0 perhaps?
>
Thanks, but I've ruled out joined fields. They don't seem to be the issue, but I'll keep
exploring.
coalesce() returns NULL if there are all NULLs.
See above post for more ^.
|
|
barryhunter
Name: Barry Hunter
Posts: 1700
|
to: vladfr, 2010-08-03 16:11:49
| reply!
>
> coalesce() returns NULL if there are all NULLs.
I mean to do SELECT ...,COALEASE(column_name,0) AS column_name,...
So if it is a null, then sphinx will see 0.
|
|
|
dilipangal
Name: Dilip Angal
Posts: 5
|
to: vladfr, 2010-08-03 22:54:45
| reply!
> > > Hey, did you find a fix? Just wondering... maybe it's a memory problem.
> > Nope
> > Don't know what is going on.
> > Can't be memory problem.
> > I have 32GB RAM on that machine and 'top' stat shows not all the memory is used.
> > There is plenty of free memory
> > Dilip
> >
>
> Hi,
>
> I'm starting to get the same problem, and it's not because of memory/cpu etc.
>
> For me, the problem seems to be with text fields.
> If I search for some keywords and add 4-5 filters, searchd crashes.
>
> I noticed that if I discard some filters on simple attributes, it works, with the same
> keywords.
>
> It started after I added a attr_multi uint with a lot of values to the index (200k, not
> that much actually).
>
Folks
My original problem was not related to outer join
I see that same query returns nothing some time and actually returns matching results,
other time.
No change to index etc.
Only difference I can think of is load.
If I do it sequentially without stressing system, it always works.
With heavy load, results are unpredictable.
This is very hard to simulate and hence debug and also difficult to report as an issue to
Sphinx support team as they will ask for re-production case which I can not provide.
Any help, pointers will be appreciated.
Dilip
|
|
|
shodan
Name: Andrew Aksyonoff
Posts: 4275
|
to: dilipangal, 2010-08-05 14:06:55
| reply!
> This is very hard to simulate and hence debug and also difficult to report as an issue to
> Sphinx support team as they will ask for re-production case which I can not provide.
We can add some custom debugging code that'd attempt to catch the data needed to repeat
the issue.
But we need to be able to repeat it of course.
|
|
|
dilipangal
Name: Dilip Angal
Posts: 5
|
to: shodan, 2010-08-05 16:07:20
| reply!
> > This is very hard to simulate and hence debug and also difficult to report as an issue
> to Sphinx support team as they will ask for re-production case which I can not provide.
>
> We can add some custom debugging code that'd attempt to catch the data needed to repeat
> the issue.
>
> But we need to be able to repeat it of course.
I would be happy to run again with custom debugging code added.
If there is a version with command line flags such as -d <level> where -d is for debug
and level such as 1, 2 which will add debugging info to the logs.
|
Common forum |
1 | 2 | 3 | 4 | 5 | ... |
273 | 274 | 275 | 276 | next »» | Create new thread
|
