Flying Sphinx: Discussion

Rake error: At least one field is necessary for an index

2011-11-30T18:58:53Z

Update: I downgraded thinking_sphinx to 1.4.9... Then I get this error when I run the rake tasks:

rake aborted!
undefined method `indexes' for #<Riddle::Configuration:0x103496d90>

So I downgraded riddle to 1.4.0 but then there is a conflict with flying sphinx requiring 1.5.0.

So I downgraded flying sphinx to 0.6.0 but then there is a conflict with farady. Omniauth wants > 0.7.3 and flying sphinx wants 0.6.1...

Arg, this is getting really frustrating. Why does it feel like I am building a house of cards..?

Rake error: At least one field is necessary for an index

2011-12-01T02:20:35Z

If you grab flying-sphinx 0.6.1, riddle 1.5.0 and TS 1.4.10, then you should be fine. If I'm wrong, let me know, but I've used that combination myself.

I know it's a little frustrating - I changed a method in Riddle, but there's no easy way to specify TS dependencies for FS, because it works with 2.x and 1.x.

Rake error: At least one field is necessary for an index

2011-12-01T16:35:10Z

That combo gives me a conflict with omniauth on faraday:

Bundler could not find compatible versions for gem "faraday":
In Gemfile:

 omniauth (~> 0.3.2) ruby depends on
   faraday (~> 0.7.3) ruby

 flying-sphinx (= 0.6.0) ruby depends on
   faraday (0.6.1)

From my Gemfile:

sphinx

gem 'riddle', '1.5.0'
gem 'thinking-sphinx', '1.4.10'
gem 'flying-sphinx', '0.6.0'

omniauth

gem 'omniauth', '~> 0.3.2'

I really need to get this sorted out ASAP, thanks!

-- Barry

Rake error: At least one field is necessary for an index

2011-12-02T01:15:12Z

Almost right - try flying-sphinx 0.6.1 instead of 0.6.0, that should be friendlier when it comes to faraday requirements.

Rake error: At least one field is necessary for an index

2011-12-02T01:39:57Z

Sorry I did try that and it installs the gems but I'm back to the
original Rake error:

Invoke fs:index (first_time) Invoke environment (first_time) Execute environment Execute fs:index Starting Index Request
rake aborted!
At least one field is necessary for an index
/opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/index/builder.rb:35:in initialize' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/index/builder.rb:22:innew' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/index/builder.rb:22:in generate' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:208:inadd_sphinx_index' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:175:in define_index' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:190:incall' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:190:in define_indexes' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:189:ineach' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/active_record.rb:189:in define_indexes' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/configuration.rb:159:ingenerate' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/configuration.rb:157:in each' /opt/local/lib/ruby/gems/1.8/gems/thinking-sphinx-1.4.10/lib/thinking_sphinx/configuration.rb:157:ingenerate' /opt/local/lib/ruby/gems/1.8/gems/flying-sphinx-0.6.1/lib/flying_sphinx/configuration.rb:21:in sphinx_configuration' /opt/local/lib/ruby/gems/1.8/gems/flying-sphinx-0.6.1/lib/flying_sphinx/index_request.rb:70:inupdate_sphinx_configuration' /opt/local/lib/ruby/gems/1.8/gems/flying-sphinx-0.6.1/lib/flying_sphinx/index_request.rb:32:in update_and_index' /opt/local/lib/ruby/gems/1.8/gems/flying-sphinx-0.6.1/lib/flying_sphinx/tasks.rb:6 /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:205:incall' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:205:in execute' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:200:ineach' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:200:in execute' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:158:ininvoke_with_call_chain' /opt/local/lib/ruby/1.8/monitor.rb:242:in synchronize' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:151:ininvoke_with_call_chain' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:144:in invoke' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:116:ininvoke_task' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:in top_level' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:ineach' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:in top_level' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:133:instandard_exception_handling' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:88:in top_level' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:66:inrun' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:133:in standard_exception_handling' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:63:inrun' /opt/local/lib/ruby/gems/1.8/gems/rake-0.9.2.2/bin/rake:33 /opt/local/bin/rake:19:in `load' /opt/local/bin/rake:19

Rake error: At least one field is necessary for an index

2011-12-02T01:44:34Z

Right - what does your define_index block look like? And does it all work fine locally with Thinking Sphinx?

Rake error: At least one field is necessary for an index

2011-12-02T01:49:43Z

No, same error for ts:index

I have had thinking sphinx working with this app before on another
server. My define_index is:

# thinking sphinx indexes define_index do

 # fields
 indexes content, :morphology => :stem_en


 # attributes
 has rank, popularity, open140_question_id
 has "ISNULL(equivalent_id)", :as => :is_primary, :type => :integer

 set_property :delta => true

end

Thanks for the help,

-- Barry

Rake error: At least one field is necessary for an index

2011-12-02T01:54:19Z

All looks fine - although `:morphology' option can't be applied on a per-field basis, so that'll have no impact.

What version of Rails are you using? And are you using Bundler to manage dependencies? Or config/environment.rb and .gems?

Rake error: At least one field is necessary for an index

2011-12-02T02:04:07Z

Rails 2.3.11 with bundler. Here is my Gemfile:

source :gemcutter
gem "rails", "2.3.11"
gem "mysql"

inline attachment for emails

gem 'inline_attachment'

prawn for pdf generation

gem 'prawn'

remit for Amazon FPS

gem 'remit', '~> 0.0.1'

hoptoad

gem 'hoptoad_notifier'

sphinx

gem 'riddle', '1.5.0'
gem 'thinking-sphinx', '1.4.10'
gem 'flying-sphinx', '0.6.1'

email validation

gem 'validates_email_format_of'

twilio for sms and voice commnuication

gem 'trails'

auth logic

gem 'authlogic', '~> 2.1.6'

omniauth

gem 'omniauth', '~> 0.3.2'
gem "tlsmail"
gem "haml"
gem "ziya"
gem "RedCloth"
gem "hpricot"
gem "rmagick"
gem 'prawn'
gem "inline_attachment"
gem "hoptoad_notifier"
gem "rufus-mnemo"
gem "trails"
gem "thin"
gem "aws-s3"
gem "pusher"
gem "twitter"
gem "jammit", :git => "git://github.com/documentcloud/jammit.git"
group :development do
gem 'yui-compressor', :git => "git://github.com/sstephenson/ruby-yui-compressor.git", :require => "yui/compressor" gem 'closure-compiler' gem 'uglifier' end

Rake error: At least one field is necessary for an index

2011-12-02T02:07:54Z

Can you try switching TS to a git reference instead?

gem 'thinking-sphinx',
  :git => 'git://github.com/freelancing-god/thinking-sphinx.git',
  :ref => 'e87898bd0f2eebb07cef79698f835c85bcbafc3a'

I had someone recently getting the same issue as you, and it was because of the vendored version of BlankSlate in Rails (though he was using a much older version of Rails, so I'm not yet convinced it's the same problem we're facing). I've just removed the BlankSlate reference from TS 1.x, just haven't released a new version with that change.

Rake error: At least one field is necessary for an index

2011-12-02T02:15:07Z

That worked!

At least locally, I'll deploy and try flying sphinx

Thanks,

-- BP

On 12/1/11 6:07 PM, Pat Allan wrote:

 gem 'thinking-sphinx',
   :git =>  'git://github.com/freelancing-god/thinking-sphinx.git',
   :ref =>  'e87898bd0f2eebb07cef79698f835c85bcbafc3a'

-- BP

Rake error: At least one field is necessary for an index

2011-12-02T02:23:34Z

Arg, I get an error when trying to deploy to Heroku. When bundler runs I
get:

    Using thinking-sphinx (1.4.10) from

git://github.com/freelancing-god/thinking-sphinx.git (at e87898b)

    Installing flying-sphinx (0.6.1)
    Installing haml (3.1.4)
    Installing hoe (2.12.4)

/usr/ruby1.8.7/lib/ruby/site_ruby/1.8/rubygems/installer.rb:170:in `install': hoe requires RubyGems version >= 1.4. Try 'gem update --system' to update RubyGems itself. (Gem::InstallError)

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/source.rb:95:in `install'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/installer.rb:55:in `run'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/spec_set.rb:12:in `each'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/spec_set.rb:12:in `each'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/installer.rb:44:in `run'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/installer.rb:8:in `install'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/cli.rb:225:in `install'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/vendor/thor/task.rb:22:in `send'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/vendor/thor/task.rb:22:in `run'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/vendor/thor/invocation.rb:118:in `invoke_task'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/vendor/thor.rb:246:in `dispatch'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/lib/bundler/vendor/thor/base.rb:389:in `start'

        from

/usr/ruby1.8.7/lib/ruby/gems/1.8/gems/bundler-1.0.7/bin/bundle:13

        from /usr/ruby1.8.7/bin/bundle:19:in `load'
        from /usr/ruby1.8.7/bin/bundle:19
    FAILED: http://devcenter.heroku.com/articles/bundler

! Heroku push rejected, failed to install gems via Bundler

I'll try to add an older version of hoe and see if that fixes it...

-- BP

Rake error: At least one field is necessary for an index

2011-12-02T02:37:06Z

That worked! I just added the following hoe dependecy in my Gem file above thinking/flying sphinx:

gem 'hoe', '2.5.0'

Thanks for the help, should I keep the git ref in my gem file?

-- Barry

Rake error: At least one field is necessary for an index

2011-12-02T02:44:53Z

Great to hear. Not sure what's bringing in the hoe reference - it's certainly none of my code. Gemfile.lock will have that information.

But yes, best to stick to the git reference, at least until there's another gem release. Locking to the specific commit reference will keep things stable as well.

Rake error: At least one field is necessary for an index

2011-12-02T03:01:54Z

FYI. Hoe is definitely coming in with flying sphinx (maybe a dependency
of a dependency?). To verify I just removed flying_sphinx (and the hoe
reference) from my Gemfile and there is no hoe in my Gemfile.lock. When
I add fs back to the Gemfile it reappears and is referenced by 'mash' if
that is any help...

-- BP

Rake error: At least one field is necessary for an index

2011-12-02T03:10:39Z

Interesting. Thanks for the clarification.

Rake error: At least one field is necessary for an index

2011-12-12T00:41:49Z

I ran into this same issue but cannot install your commit sha due to my app being rails 3.1.3 it says:

Bundler could not find compatible versions for gem "activerecord":
In snapshot (Gemfile.lock):

activerecord (3.1.3)

In Gemfile:

thinking-sphinx (>= 0) ruby depends on
  activerecord (< 3.0.0, >= 1.15.6) ruby

Running bundle update will rebuild your snapshot from scratch, using only
the gems in your Gemfile, which may resolve the conflict.

[production][~/code/planet-documentary] bundle update Updating git://github.com/freelancing-god/thinking-sphinx.git
Updating git://github.com/mbleigh/acts-as-taggable-on.git
Fetching source index for http://rubygems.org/
Bundler could not find compatible versions for gem "activerecord":
In Gemfile:

flying-sphinx (= 0.6.1) ruby depends on
  activerecord (< 3.0.0, >= 1.15.6) ruby

rails (~> 3.1.3) ruby depends on
  activerecord (3.1.3)

But I also have the error about indexes on Riddle in production (but not development)

Rake error: At least one field is necessary for an index

2011-12-12T00:47:12Z

Hi Joe

What does your reference for thinking-sphinx look like in your Gemfile?

Rake error: At least one field is necessary for an index

2011-12-12T00:50:40Z

Weird

Now I see this in the log

using config file '/mnt/sphinx/flying-sphinx/d5b836d6d3c11a2f4/sphinx.conf'...
indexing index 'documentary_core'...
ERROR: index 'documentary_core': sql_range_query: ERROR: syntax error at or near ","
LINE 1: ...entaries"."title", "documentaries"."description", , , "docum...

(DSN=pgsql://hzciydhmkw:***@127.0.0.1:10314/hzciydhmkw). total 0 docs, 0 bytes
total 0.121 sec, 0 bytes/sec, 0.00 docs/sec
skipping non-plain index 'documentary'...
total 0 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 0 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

From the index logs

It worked in development (ts:index) ... fs:index gave memory allocation error but seemed to run fine in production:

[production][~/code/planet-documentary] heroku run rake cron Running rake cron attached to terminal... up, run.7
Starting Index Request
Index Request has completed.

Rake error: At least one field is necessary for an index

2011-12-12T00:55:04Z

This is my only configured model:

define_index do

indexes title
indexes description
indexes :tag_list
indexes :category_title

end

tag_list is a method given by ActsAsTaggableOn
category_title is a delegated attribute on the category association

Rake error: At least one field is necessary for an index

2011-12-12T00:59:48Z

You can only have columns (and columns via associations) in your index definitions - Sphinx talks to your database directly, not through Ruby/Rails, so you'll want to try something like this instead:

define_index do
  indexes title, description
  indexes taggings.tag.name, :as => :tags
  indexes category.title, :as => :category_title
end

Rake error: At least one field is necessary for an index

2011-12-12T01:08:36Z

That did it!

Man how awesome that I got such fast support on a Sunday night.

Thanks!

Rake error: At least one field is necessary for an index

2011-12-12T01:11:43Z

I don't know if you can help me with my connection error at all, I've submitted a ticket with Heroku Support but the error is this

Error Message:
Riddle::ConnectionError: Connection to ec2-184-73-20-134.compute-1.amazonaws.com on 9314 failed. Connection refused - connect(2)

Where:
search#new
[PROJECT_ROOT]/vendor/bundle/ruby/1.9.1/gems/riddle-1.5.0/lib/riddle/client.rb, line 575

URL:
http://www.planetdocumentary.com/search?utf8=%E2%9C%93&query=co...

Rake error: At least one field is necessary for an index

2011-12-12T01:14:09Z

Hah, well it is just after midday on Monday afternoon here :)

As for that error, have you started the daemon now that indexing is working? heroku run rake fs:start

Rake error: At least one field is necessary for an index

2011-12-12T01:15:32Z

Yep! That was it! Whups! Sorry… I assumed it would happen as either part of the add-on installation or in heroku's deploy hooks (kind of like new relic)

Rake error: At least one field is necessary for an index

2011-12-12T01:17:01Z

So yeah I would update the docs:

gem 'thinking-sphinx', '2.0.10'
gem 'flying-sphinx', '0.6.1'

and

heroku run rake fs:start (for heroku addon docs, which seem to be a copy of your main docs) (run is for cedar)

Thanks!!