flying-sphinx index Hangs

Liam Elliott's Avatar

Liam Elliott

12 Jun, 2017 02:16 AM

I have tried running flying-sphinx and likewise bundle exec rake fs:index and the process just hangs on "INFO -- : Executing Action: index". I have configured the certificate chain to use a MySQL database from ClearDB. The application deploys to heroku without issue and I can see successful queries in the heroku logs, but nothing is showing an obvious error. I always have to ctrl-c out of the process as it runs for far too long and goes nowhere. The result of running heroku run bundle exec rake fs:index is:

/app/vendor/bundle/ruby/2.3.0/gems/newrelic_rpm-3.9.1.236/lib/new_relic/agent/configuration/default_source.rb:675: warning: key :disable_mongo is duplicated and overwritten on line 987
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Starting the New Relic agent in "production" environment.
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : To prevent agent startup add a NEWRELIC_AGENT_ENABLED=false environment variable or modify the "production" section of your newrelic.yml.
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Reading configuration from config/newrelic.yml
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] WARN : Agent is configured not to use SSL when communicating with New Relic's servers
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Environment: production
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : No known dispatcher detected.
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Application: Sharetribe
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : delayed_job not available: No DJ worker present
/app/vendor/bundle/ruby/2.3.0/gems/newrelic_rpm-3.9.1.236/lib/new_relic/agent/vm/mri_vm.rb:32: warning: GC.stat keys were changed from Ruby 2.1. In this case, you refer to obsolete `total_allocated_object' (new key is `total_allocated_objects'). Please check <https://bugs.ruby-lang.org/issues/9924> for more information.
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Dalli Memcache instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing DelayedJob instrumentation [part 1/2]
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Net instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing deferred Rack instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Rack::Builder middleware instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Rails 3+ middleware instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing ActiveRecord 4 instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Rails 4 Error instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Rails 4 view instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Installing Rails 4 Controller instrumentation
** [NewRelic][06/12/17 01:12:49 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Finished instrumentation
I, [2017-06-12T01:12:50.065723 #4] INFO -- : Executing Action: configure
** [NewRelic][06/12/17 01:12:50 +0000 48878c54-80b8-4384-8844-a7f4abd68535 (4)] INFO : Reporting to: https://rpm.newrelic.com/accounts/1653428/applications/53911869
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:19: warning: UploadIO#respond_to?(:to_ary) is old fashion which takes only one parameter
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:105: warning: respond_to? is defined here
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:19: warning: UploadIO#respond_to?(:to_ary) is old fashion which takes only one parameter
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:105: warning: respond_to? is defined here
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:19: warning: UploadIO#respond_to?(:to_ary) is old fashion which takes only one parameter
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:105: warning: respond_to? is defined here
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:19: warning: UploadIO#respond_to?(:to_ary) is old fashion which takes only one parameter
/app/vendor/bundle/ruby/2.3.0/gems/multipart-post-1.2.0/lib/composite_io.rb:105: warning: respond_to? is defined here
I, [2017-06-12T01:12:53.840877 #4] INFO -- : Action Finished: configure
I, [2017-06-12T01:12:53.841054 #4] INFO -- : Executing Action: index
^Crake aborted!

How can I fix this?

  1. 1 Posted by Liam Elliott on 12 Jun, 2017 02:18 AM

    Liam Elliott's Avatar

    If it is needed, the application is hosted at lehhko.herokuapp.com

  2. Support Staff 2 Posted by Pat Allan on 12 Jun, 2017 02:26 AM

    Pat Allan's Avatar

    Hi Liam,

    Thanks for getting in touch, and providing the app name, that’s definitely helped me investigate a bit further.

    I’m not yet sure of the cause of the problem though… but I can see in the logs that a full index (as part of the rebuild command) takes less than a minute, so I’d expect to have the command wrap up by then. However, while I’m seeing the configure commands coming through (as noted in the output you shared), I’m not seeing indexing requests appear, which is definitely odd.

    Can you confirm the versions of flying-sphinx and thinking-sphinx gems you’re using?

    Thanks,


    Pat

  3. 3 Posted by Liam Elliott on 12 Jun, 2017 02:30 AM

    Liam Elliott's Avatar

    Hi Pat, thanks for the speedy reply. I am running:

    flying-sphinx (1.2.0)
    thinking-sphinx (3.1.4)

  4. Support Staff 4 Posted by Pat Allan on 12 Jun, 2017 02:33 AM

    Pat Allan's Avatar

    Just figured out the problem - some overzealous caching which wasn’t up-to-date with the fact you’d configured your app (indexing doesn’t bother attempting otherwise - a relatively new change (and thus, new bug) I’d made).

    I’ve cleared the cache and am in the process of putting in a permanent fix, but indexing will work for your app right now :)

  5. 5 Posted by Liam Elliott on 12 Jun, 2017 02:36 AM

    Liam Elliott's Avatar

    Holy crap, thanks a lot Pat! Honestly, I'm incredibly impressed with the customer service. If this is how you guys generally respond to concerns, keep up the good work!

  6. Support Staff 6 Posted by Pat Allan on 12 Jun, 2017 02:39 AM

    Pat Allan's Avatar

    I certainly aim to be quick, though the timing was just particularly good on your part, I wasn’t in the middle of anything else (and it’s also the middle of my day right now) 

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac