<?xml version="1.0"?>
<rss xmlns:dc="http://purl.org/dc/elements/1.1/" version="2.0">
  <channel>
    <title>Transition Technology: Ticket #286: Data loss on save, Cache Router issue?</title>
    <link>http://localhost:8080/trac/ticket/286</link>
    <description>&lt;ul&gt;&lt;li&gt;It seems admin pages are now not saving in some cases.
&lt;/li&gt;&lt;li&gt;&lt;a class="closed ticket" href="http://localhost:8080/trac/ticket/245" title="defect: Profile editing bugs (closed: duplicate)"&gt;#245&lt;/a&gt; - Profile editing bugs
&lt;/li&gt;&lt;li&gt;&lt;a class="closed ticket" href="http://localhost:8080/trac/ticket/260" title="defect: Paredes profile issues (closed: duplicate)"&gt;#260&lt;/a&gt; - Paredes profile issues
&lt;/li&gt;&lt;li&gt;lots of errors in watchdog from the Cache Router module, e.g.:
&lt;pre class="wiki"&gt;Type	cache
Date	Wednesday, 29 June 2011 - 11:51pm
User	Transition Admin
Location	https://www.transitionnetwork.org/admin/settings/piwik
Referrer	https://www.transitionnetwork.org/admin/settings/piwik
Message	Cache write error, failed to open file "sites/default/files/filecache/cache/8/variables-87cd8b8808600624d8c590cfc2e6e94b"
Severity	error
Hostname	86.184.163.71
&lt;/pre&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;
I think we have a critical data saving issue, probably related to Cache Router not being able to get a write lock for the 'Variables' table's cache file. I've already found and added to the issue at: &lt;a class="ext-link" href="http://drupal.org/node/1152310"&gt;&lt;span class="icon"&gt;​&lt;/span&gt;http://drupal.org/node/1152310&lt;/a&gt;
&lt;/p&gt;
&lt;p&gt;
Need to disable module on LIVE tomorrow to see if the issues stop, or track down other possible sources. Thought it deserved a ticket as it's possibly losing us entered user content - and probably more.
&lt;/p&gt;
</description>
    <language>en-us</language>
    <image>
      <title>Transition Technology</title>
      <url>/trac/chrome/site/TransitionNetwork-Logo-Web-Small.jpg</url>
      <link>http://localhost:8080/trac/ticket/286</link>
    </image>
    <generator>Trac 0.12.5</generator>
    <item>
      
        <dc:creator>ed</dc:creator>

      <pubDate>Thu, 30 Jun 2011 06:23:53 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:1</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:1</guid>
      <description>
        &lt;p&gt;
definitely worth a ticket!
&lt;/p&gt;
&lt;p&gt;
NB: we may not have chris today if that's relevant - it's J30 strike day..
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Thu, 30 Jun 2011 09:14:53 GMT</pubDate>
      <title>priority, status changed</title>
      <link>http://localhost:8080/trac/ticket/286#comment:2</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:2</guid>
      <description>
          &lt;ul&gt;
            &lt;li&gt;&lt;strong&gt;priority&lt;/strong&gt;
                changed from &lt;em&gt;critical&lt;/em&gt; to &lt;em&gt;blocker&lt;/em&gt;
            &lt;/li&gt;
            &lt;li&gt;&lt;strong&gt;status&lt;/strong&gt;
                changed from &lt;em&gt;new&lt;/em&gt; to &lt;em&gt;assigned&lt;/em&gt;
            &lt;/li&gt;
          &lt;/ul&gt;
        &lt;p&gt;
Don't need Chris for this one.
&lt;/p&gt;
&lt;p&gt;
Cache router now disabled, and lo, the errors hath become quiet verily...
&lt;/p&gt;
&lt;p&gt;
I reckon the update I made in late May from Cache Router RC1 -&amp;gt; RC2 caused all of the above issues we face and more.
&lt;/p&gt;
&lt;p&gt;
I have doubts about the integrity of some of the system, especially stuff done in the last couple of weeks. For example, now seeing errors like:
&lt;/p&gt;
&lt;pre class="wiki"&gt;
Location	http://www.transitionnetwork.org/resources
Referrer
Message	Warning: Invalid argument supplied for foreach() in fivestar_views_value_display_handler() (line 1668 of /web/transitionnetwork.org/www/sites/all/modules/fivestar/fivestar.module).
&lt;/pre&gt;&lt;p&gt;
And that line of code tries to access the site's data schema to connect nodes to their votes
&lt;/p&gt;
&lt;div class="code"&gt;&lt;pre&gt;&lt;span class="x"&gt;    // Find the VotingAPI tag for this field.
    foreach ($field-&amp;gt;query-&amp;gt;table_queue[$field-&amp;gt;relationship]['join']-&amp;gt;extra as $votingapi_setting) {
      if ($votingapi_setting['field'] == 'tag') {
        $tag = $votingapi_setting['value'];
      }
    }
&lt;/span&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;
So we may have to re-install VotingAPI and &lt;a class="missing wiki"&gt;FiveStar?&lt;/a&gt;. Will re-save the options forms first to see if that corrects the issue.
&lt;/p&gt;
&lt;p&gt;
But the main thing is: We cannot use &lt;a class="missing wiki"&gt;CacheRouter?&lt;/a&gt; in File mode any more. &lt;a class="missing wiki"&gt;Varnish/Memcache?&lt;/a&gt; use it for different backends so they don't use file caching. I'll continue to add to this ticket as I close down other errors and get any joy on &lt;a class="ext-link" href="http://drupal.org/node/1152310"&gt;&lt;span class="icon"&gt;​&lt;/span&gt;http://drupal.org/node/1152310&lt;/a&gt;
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>ed</dc:creator>

      <pubDate>Thu, 30 Jun 2011 09:26:15 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:3</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:3</guid>
      <description>
        &lt;p&gt;
good work that man!
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Thu, 30 Jun 2011 09:26:38 GMT</pubDate>
      <title>milestone set</title>
      <link>http://localhost:8080/trac/ticket/286#comment:4</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:4</guid>
      <description>
          &lt;ul&gt;
            &lt;li&gt;&lt;strong&gt;milestone&lt;/strong&gt;
                set to &lt;em&gt;Phase 4&lt;/em&gt;
            &lt;/li&gt;
          &lt;/ul&gt;
        &lt;p&gt;
Duh.
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Thu, 30 Jun 2011 10:16:58 GMT</pubDate>
      <title>priority changed</title>
      <link>http://localhost:8080/trac/ticket/286#comment:5</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:5</guid>
      <description>
          &lt;ul&gt;
            &lt;li&gt;&lt;strong&gt;priority&lt;/strong&gt;
                changed from &lt;em&gt;blocker&lt;/em&gt; to &lt;em&gt;major&lt;/em&gt;
            &lt;/li&gt;
          &lt;/ul&gt;
        &lt;p&gt;
I've removed and re-installed Fivestart and VotingAPI but the errors were still appearing in Watchdog, one for each &lt;a class="missing wiki"&gt;FiveStar?&lt;/a&gt; being shown.
&lt;/p&gt;
&lt;p&gt;
So I've added the PHP code in a field I fixed the issue with in the Group Resources view and it's all cleared up.
&lt;/p&gt;
&lt;p&gt;
Downgrading, but will keep open until something happens on &lt;a class="ext-link" href="http://drupal.org/node/1152310"&gt;&lt;span class="icon"&gt;​&lt;/span&gt;http://drupal.org/node/1152310&lt;/a&gt;
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Fri, 01 Jul 2011 16:25:21 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:6</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:6</guid>
      <description>
        &lt;p&gt;
I noted as soon as we re-added &lt;a class="missing wiki"&gt;CacheRouter?&lt;/a&gt; this morning, lots of settings were odd and old, plus Piwik hasnt' been getting any stats for a while.
&lt;/p&gt;
&lt;p&gt;
I've since realised perhaps this is to do with the remaining files in the /sites/default/files/filecache folder being old and/or locked somehow still.
&lt;/p&gt;
&lt;p&gt;
I've just completely wiped (&lt;tt&gt;sudo rm -R *&lt;/tt&gt;) the contents of the folder and all the settings are magically back, and piwik works, as does the new /video page!
&lt;/p&gt;
&lt;p&gt;
I now have even less faith in CR file engine, since when one 'clears all caches' it should wipe these files too... It appears it's not been. That is very dangerous.
&lt;/p&gt;
&lt;p&gt;
I'll continue to keep an eye on things...
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Wed, 06 Jul 2011 16:47:15 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:7</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:7</guid>
      <description>
        &lt;p&gt;
OK, getting bored of: a) having to keep manually wiping the filecache folder, b) the lack of response to a critical issue by the CR people.
&lt;/p&gt;
&lt;p&gt;
So I'm rolling back to a previous version (RC1) until we're ready to get Varnish going on LIVE.
&lt;/p&gt;
&lt;p&gt;
Will update tonight out of hours.
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>chris</dc:creator>

      <pubDate>Thu, 07 Jul 2011 10:16:48 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:8</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:8</guid>
      <description>
        &lt;blockquote class="citation"&gt;
&lt;p&gt;
getting bored of: a) having to keep manually wiping the filecache folder ... rolling back to a previous version ... Will update tonight out of hours.
&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;
Did you roll back already? If not I could sort a cron job to delete the files that need deleting?
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Thu, 07 Jul 2011 11:32:56 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:9</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:9</guid>
      <description>
        &lt;p&gt;
Didn't have time or energy to do it last night...
&lt;/p&gt;
&lt;p&gt;
Don't worry about it Chris, the file cache as of RC2 is fundamentally broken, RC1 worked and didn't cause file locking issues. A single process (request) can lock its own files and get confused!
&lt;/p&gt;
&lt;p&gt;
Roll back will happen sometime today/tongight depending on other tickets.
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Fri, 08 Jul 2011 12:35:06 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:10</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:10</guid>
      <description>
        &lt;p&gt;
RC1 has the same obsolete data appearing issue as RC2.
&lt;/p&gt;
&lt;p&gt;
The sooner we drop the file engine, the better. In the mean time I'll try RC2 back on DEV to compare to RC1 and then, once Chris is ready, push RC2 back to the server.
&lt;/p&gt;
&lt;p&gt;
Next week, obviously.
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>ed</dc:creator>

      <pubDate>Tue, 12 Jul 2011 14:25:25 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:11</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:11</guid>
      <description>
        &lt;p&gt;
hoping that the varnish thing works...
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Wed, 13 Jul 2011 12:54:01 GMT</pubDate>
      <title></title>
      <link>http://localhost:8080/trac/ticket/286#comment:12</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:12</guid>
      <description>
        &lt;p&gt;
Since &lt;a class="closed ticket" href="http://localhost:8080/trac/ticket/224" title="defect: Add Varnish cache (closed: fixed)"&gt;#224&lt;/a&gt; is done we're no-longer using cache router's file cache, so this is closed.
&lt;/p&gt;
      </description>
      <category>Ticket</category>
    </item><item>
      
        <dc:creator>jim</dc:creator>

      <pubDate>Wed, 13 Jul 2011 12:54:07 GMT</pubDate>
      <title>status changed; resolution set</title>
      <link>http://localhost:8080/trac/ticket/286#comment:13</link>
      <guid isPermaLink="false">http://localhost:8080/trac/ticket/286#comment:13</guid>
      <description>
          &lt;ul&gt;
            &lt;li&gt;&lt;strong&gt;status&lt;/strong&gt;
                changed from &lt;em&gt;assigned&lt;/em&gt; to &lt;em&gt;closed&lt;/em&gt;
            &lt;/li&gt;
            &lt;li&gt;&lt;strong&gt;resolution&lt;/strong&gt;
                set to &lt;em&gt;fixed&lt;/em&gt;
            &lt;/li&gt;
          &lt;/ul&gt;
      </description>
      <category>Ticket</category>
    </item>
 </channel>
</rss>