tag:support.flying-sphinx.com,2011-01-05:/discussions/problems/57954-failure-to-start-no-such-file-or-directory-not-servingFlying Sphinx: Discussion 2019-07-15T14:45:41Ztag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-06-26T19:45:18Z2019-06-26T19:45:18ZFailure to start: No such file or directory; NOT SERVING<div><p>It looks like trying again several times resolved the problem.</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-06-27T03:48:37Z2019-06-27T03:48:37ZFailure to start: No such file or directory; NOT SERVING<div><p>Hi Sean,</p>
<p>Sorry that something didn’t quite go to plan the first time around - though it’s good to know things are working more smoothly now.</p>
<p>I’ll definitely have a look to try to make sure such issues don’t crop up again. Can you let me know which version/language of the flying-sphinx client library you’re using?</p>
<p>Thanks,</p>
<p>— Pat</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-03T03:05:21Z2019-07-03T03:05:21ZFailure to start: No such file or directory; NOT SERVING<div><p>Sure! I'm using Node.js libraries "<a href="mailto:flying-sphinx@0.2.3">flying-sphinx@0.2.3</a>" and "<a href="mailto:sphinx-promise@1.0.5">sphinx-promise@1.0.5</a>", which depends on "<a href="mailto:sphinxapi@1.3.0">sphinxapi@1.3.0</a>".</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-14T12:47:20Z2019-07-14T12:47:20ZFailure to start: No such file or directory; NOT SERVING<div><p>Hi Sean,</p>
<p>Thanks for providing those details. The node client had been neglected for quite some time, but I’ve spent a good part of the last week updating it significantly. It now uses the v5 Flying Sphinx API (previously it’d been using v3), which is more reliable, using websockets to track action results (rather than polling, or just running long-lived requests).</p>
<p>These changes are released as v1.0.0 of the NPM package - if you have the chance to give it a shot, that’d be great! Do note the updated approach for managing configuration:<br>
<a href="https://github.com/flying-sphinx/flying-sphinx-js#configuration">https://github.com/flying-sphinx/flying-sphinx-js#configuration</a> <a href="https://github.com/flying-sphinx/flying-sphinx-js#configuration">https://github.com/flying-sphinx/flying-sphinx-js#configuration</a><br>
(But the old approach should continue to work, and none of the public syntax has changed.)</p>
<p>One thing that’s now possible with the client updates and the configuration changes is the ability to specify the version of Sphinx you want to use. The old default was v2.0.6, which is quite ancient in Sphinx terms. I recommend updating to v2.2.11 (or even 3.1.1 - depending on what you use locally, of course!). Both of these versions should improve performance, and possibly reduce the Sphinx index file size. However: making this change will result in the need to rebuild your Sphinx setup (taking the daemon offline while the re-indexing happens), so definitely give this a spin on your staging environment first, and plan the production update for a time/situation where Sphinx being down will impact as few people as possible.</p>
<p>If you hit any issues with this new NPM package version, do let me know. I’ve tested it out (and it has a test suite covering all current Node versions), but definitely keen for feedback and feature suggestions from customers. Ruby is the language that has historically gotten the most love by Flying Sphinx customers, hence I’m especially keen on input from those using different languages.</p>
<p>Kind regards,</p>
<p>— Pat</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T13:43:15Z2019-07-15T13:43:16ZFailure to start: No such file or directory; NOT SERVING<div><p>Hey Pat! We'll check out the new version and let you know how it goes.</p>
<p>Right now, we're having the same issue again. Now that we're using this in production, our production searches are down. Can you look into this for us?</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T13:45:39Z2019-07-15T13:45:40ZFailure to start: No such file or directory; NOT SERVING<div><p>Oh! I just saw that we received an error email, but I'm still not sure what to do about it.</p>
<blockquote>
<p>ERROR: index 'JobIndex': raw_hits: write error: 92303 of 1048450 bytes written.</p>
</blockquote></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T13:57:07Z2019-07-15T13:57:07ZFailure to start: No such file or directory; NOT SERVING<div><p>Hi Sean,</p>
<p>I’m just having a look now, but it might be that your disk usage is actually jumping up significantly and you’re maxing out the server’s disk space:<br>
<a href="https://stackoverflow.com/questions/4367556/what-does-the-error-error-index-product-raw-hits-write-error-122070-of-26">https://stackoverflow.com/questions/4367556/what-does-the-error-err...</a> <a href="https://stackoverflow.com/questions/4367556/what-does-the-error-error-index-product-raw-hits-write-error-122070-of-26">https://stackoverflow.com/questions/4367556/what-does-the-error-error-index-product-raw-hits-write-error-122070-of-26</a></p>
<p>I can see that you’re running another indexing request now, so I’m keeping an eye on the disk space. There’s about 45GB free… so using all of that would be rather worrying - but you’re already using 20GB! I’m going to kill your existing indexer process, remove all existing index files (given they’re not usable at this point), just to ensure there’s as much disk space available as possible, and then run the indexer myself.</p>
<p>I’ll let you know how it goes.</p>
<p>— Pat</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:03:47Z2019-07-15T14:03:47ZFailure to start: No such file or directory; NOT SERVING<div><p>Just further to this, while the indexer is running again:</p>
<ul>
<li>From memory, your first full index process took over half an hour - so our best case scenario is probably that kind of timeframe - unless all the disk space disappears again!</li>
<li>Upgrading Sphinx to v2.2.11 might help speed and disk usage - given you've got this downtime anyway, should I manually set it to use v2.2.11 instead of v2.0.6? (The implications of this is that you shouldn't run the configure command using the 0.2.3 version of the flying-sphinx package, as that'd overwrite things back to v2.0.6).</li>
<li>How many records are in your jobs table? We've hit about 200k records processed thus far.</li>
</ul></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:12:02Z2019-07-15T14:12:03ZFailure to start: No such file or directory; NOT SERVING<div><p>Thanks for checking on this!</p>
<p>Sphinx Version: Yeah, if you think that'll help. I'm updating the node package locally now anyway.</p>
<p>Record Count: 1,236,233</p>
<p>Disk Space: We were including a large "description" column before, but have removed that. We did add more records since the last build, but I was hoping the column removal would make up for that in disk size. Let's see where we end up after this new clean run.</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:17:57Z2019-07-15T14:17:57ZFailure to start: No such file or directory; NOT SERVING<div><p>Just killed my first manual attempt (using 2.0.6), switched to 2.2.11…</p>
<p>The 2.0.6 run had gotten to 324k records in 16 minutes. The 2.2.11 run has just hit the same mark in 4 minutes.</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:20:34Z2019-07-15T14:20:38ZFailure to start: No such file or directory; NOT SERVING<div><p>Oh nice! Thanks for the update!</p>
<p>Does the new node package default to using Sphinx 2.2.11? That's what we use locally. I'm mostly wondering if I need to use the JavaScript configuration at all. If so, does it need to look like this?</p>
<pre>
<code>configuration.process('configure', function(configurer) {
configurer.addEngine('sphinx');
// http://support.flying-sphinx.com/kb/configuration/setting-your-sphinx-version
configurer.addVersion('2.2.11');
});</code>
</pre>
<p>I'll hold off on pushing anything, for sure. I'm just wondering for after we figure this out.</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:25:49Z2019-07-15T14:25:49ZFailure to start: No such file or directory; NOT SERVING<div><p>The new v1.0.0 NPM package will not overwrite the version if you don't specify one (v0.2.3 will, though).</p>
<p>Granted, it doesn't hurt to have it set as part of your configuration process, but yeah, that's not something you need to do right now.</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:39:04Z2019-07-15T14:39:05ZFailure to start: No such file or directory; NOT SERVING<div><p>I see search results again! I have a change ready on our end to upgrade the npm package and specify sphinx version 2.2.11. Should I deploy that?</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:40:08Z2019-07-15T14:40:08ZFailure to start: No such file or directory; NOT SERVING<div><p>May have been a brief blip with the daemon just then - it had booted up with 2.0.6 thanks to monit, but is now 2.2.11. Feel free to deploy the new NPM package :)</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:40:40Z2019-07-15T14:40:40ZFailure to start: No such file or directory; NOT SERVING<div><p>Disk usage is down to 1.4GB too! 🎉</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:42:46Z2019-07-15T14:42:46ZFailure to start: No such file or directory; NOT SERVING<div><p>The output of the indexer, given that because it was a manual invocation it won't appear in your Flying Sphinx dashboard:</p>
<pre>
<code>Sphinx 2.2.11-id64-release (95ae9a6)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
using config file '/mnt/local/flying-sphinx/552dde8b36b080ec0/sphinx.conf'...
indexing index 'JobIndex'...
collected 1236233 docs, 3131.0 MB
sorted 361.1 Mhits, 100.0% done
total 1236233 docs, 3130995478 bytes
total 1492.916 sec, 2097234 bytes/sec, 828.06 docs/sec
total 544 reads, 0.481 sec, 2823.8 kb/call avg, 0.8 msec/call avg
total 3046 writes, 2.066 sec, 989.7 kb/call avg, 0.6 msec/call avg</code>
</pre>
<p>Took 25 minutes.</p></div>Pat Allantag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:43:49Z2019-07-15T14:43:50ZFailure to start: No such file or directory; NOT SERVING<div><p>Great! Thanks a bunch for your help.</p></div>Sean Massatag:support.flying-sphinx.com,2011-01-05:Comment/473875252019-07-15T14:45:39Z2019-07-15T14:45:39ZFailure to start: No such file or directory; NOT SERVING<div><p>No worries at all, great to have everything upgraded and working faster and with lower disk usage. If there's any other queries or issues, do let me know. (Though right now it's approaching 1am here in Melbourne, so I'll likely be asleep for any immediate questions!)</p></div>Pat Allan