{"id":888,"date":"2014-08-01T16:59:56","date_gmt":"2014-08-01T20:59:56","guid":{"rendered":"http:\/\/blog.uvm.edu\/ctl-projects\/?p=888"},"modified":"2014-08-01T16:59:56","modified_gmt":"2014-08-01T20:59:56","slug":"geology-landscape-change-project-exploded-chapter-5","status":"publish","type":"post","link":"https:\/\/blog.uvm.edu\/waw\/2014\/08\/01\/geology-landscape-change-project-exploded-chapter-5\/","title":{"rendered":"Geology Landscape Change project exploded Chapter 5"},"content":{"rendered":"


On Aug 1, 2014, at 10:56 AM, Jim Lawson wrote:<\/span>

<\/p>\n

The session data stored for this webapp is … large. \u00a0We’ve moved it
\nout of the database and onto the local filesystem, which has helped the
\ndatabase a lot, but now we’re just filling the local disk (and probably
\nthrashing I\/O besides)<\/p>\n

Currently there are 3126 session data files in \/tmp\/glcp. \u00a046 of them
\nare over 100MB in size! \u00a0A gross way we could handle this is a cron job
\nthat runs (say once an hour):<\/p>\n

find \/tmp\/glcp -type f -size +5M -exec rm -f {} ;<\/p>\n

Really, this app should not store so much data in the session! \u00a0But you
\nasked for “what SAA can do about this”.<\/p>\n

Any other suggestions?<\/p>\n

 <\/p><\/blockquote>\n

I’ve been mulling this over for a week now and getting nowhere. Perform a search -> store results ‘set’ in session -> read from session to display results -> retain last MAX_SETS Results is the central,design philosophy of the application ( as designed by long gone CS grad student). Search for trees, get 2000+ results! what should we do with them?<\/span>

The related problem: start_session when session > 100mb results in php out of memory error. Can we crank this up, too?<\/span>

Couple of things I’ll try: change max_sets from current 7 to 2 or 3. Remove browse all 75000 images option, too unwieldy. Expire sessions more freqently.\u00a0<\/span>

Clearly this app does not scale well. \u00a0Good mews is much code assumes a 5 digit ID number, so we are limited to 99999 images.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

On Aug 1, 2014, at 10:56 AM, Jim Lawson wrote: The session data stored for this webapp is … large. \u00a0We’ve moved it out of the database and onto the local filesystem, which has helped the database a lot, but … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41826],"tags":[42758,12386,45193,647],"class_list":["post-888","post","type-post","status-publish","format-standard","hentry","category-wes","tag-boffins","tag-database","tag-geology-landscape-change","tag-php"],"_links":{"self":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts\/888","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/comments?post=888"}],"version-history":[{"count":0,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts\/888\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/media?parent=888"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/categories?post=888"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/tags?post=888"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}