{"id":833,"date":"2013-05-20T12:13:09","date_gmt":"2013-05-20T16:13:09","guid":{"rendered":"http:\/\/blog.uvm.edu\/ctl-projects\/?p=518"},"modified":"2013-05-20T12:13:09","modified_gmt":"2013-05-20T16:13:09","slug":"new-landscape-server","status":"publish","type":"post","link":"https:\/\/blog.uvm.edu\/waw\/2013\/05\/20\/new-landscape-server\/","title":{"rendered":"New Landscape Server"},"content":{"rendered":"<p>Ben Coddington told me:<\/p>\n<blockquote><p><em>We&#8217;ve had some loading lately when bots crawl \/landscape. \u00a0Looks like \/landscape often opens its own files through the web server, which clogs things up.<\/em><\/p>\n<p><em>The worst requests are like these:<\/em><\/p>\n<p><em>\/landscape\/search\/details.php?ls=55237&amp;sequence=000&amp;set_seq=3533&amp;imageSet=1367046201-517b7839a64eb&amp;AddRel=<\/em><\/p>\n<p><em>They make several self-requests to load image files through the web server, even though only HTML is returned. \u00a0I got to looking at the code a bit, and it looks like there&#8217;s a test to see if an image exists before writing out the HTML to load the image, but that test actually loads the image into the web server.<\/em><\/p>\n<p><em>There are some other optimizations that can be done here as well; there are some very long-running database queries. \u00a0Would you be willing to work with me to make the site run a bit better? \u00a0Right now, indexing of this site causes all the SAA pagers to make noise &#8211; and that happens a couple times a day.<\/em><\/p>\n<p>&nbsp;<\/p><\/blockquote>\n<p>I made some code changes but was reminded that it was doing what it was doing because of php &#8220;Safe Mode&#8221; and we needed to change fuel permissions and ownership on tens of thousands of file for the code changes to work. This prompted Ben and Mike Austin to conclude:<\/p>\n<blockquote><p><em>Might be nice to get this thing on a dedicated server &#8212; we could turn off safe_mode, and the filesystem access would be much faster. \u00a0Then it could age gracefully without UVM dancing around trying to fit it into our architecture over and over again.<\/em><\/p>\n<p><em>How would you feel about that?<\/em><\/p><\/blockquote>\n<p>Turns out it didn&#8217;t matter how I felt, it is happening anyway. And of course, it isn&#8217;t all smooth sailing &#8212; walking the website now, finding and squashing bugs.<\/p>\n<p>as far as sql goes,The most common query &#8212; the quick search &#8212; was performing a full text query on a set \u00a0of fields which did not match the fields in the fulltext index. \u00a0rebuilt the index, and queries formerly taking 3-4 seconds are now clocking in at 2.1ms .<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ben Coddington told me: We&#8217;ve had some loading lately when bots crawl \/landscape. \u00a0Looks like \/landscape often opens its own files through the web server, which clogs things up. The worst requests are like these: \/landscape\/search\/details.php?ls=55237&amp;sequence=000&amp;set_seq=3533&amp;imageSet=1367046201-517b7839a64eb&amp;AddRel= They make several self-requests &hellip; <a href=\"https:\/\/blog.uvm.edu\/waw\/2013\/05\/20\/new-landscape-server\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41829,41826],"tags":[42758,45193,647],"class_list":["post-833","post","type-post","status-publish","format-standard","hentry","category-project-summary","category-wes","tag-boffins","tag-geology-landscape-change","tag-php"],"_links":{"self":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts\/833","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/comments?post=833"}],"version-history":[{"count":0,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/posts\/833\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/media?parent=833"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/categories?post=833"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.uvm.edu\/waw\/wp-json\/wp\/v2\/tags?post=833"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}