Performance Increases

Posted by Jesse Andrews on Aug 1, 2008

Database, CPU and RAM usage cut in half. Slow parts of the site targeted. Thanks to New Relic.

I posted on my blog about improvements made on this site thanks to a Rails performance monitoring tool New Relic.

Long story short, viewing a script page should be much quicker now!

Looking at a chart of the slowest actions on the site we see that: updating a script, viewing the index of tags, and uploading a new version of the source of a script are the worst offenders.

Most of the slowness of updating the script is due to re-indexing into Solr. Currently that happens during the request cycle - leading to the user waiting while the search index updates. I'm planning to moving this to more of a queue based system.

I think the users and scripts index can be improved with an index as well, but will have to investigate this weekend.

Is there anything slow on the site that I (and New Relic) has missed?

You could comment on this post if you were logged in.

1 point
login to vote
Posted Aug 1, 2008

That's great news, I notice it already!

1 point
login to vote
Posted Aug 3, 2008

I know you mentioned it, but every time I update my Google Extra script, it takes a good 10 minutes or so to load the page (freezing Firefox in the process). This isn't something I have to do hugely often, but it is quite an annoyance. Any improvements to that situation are very welcome.

1 point
login to vote
Jesse Andrews article's author
Posted Aug 4, 2008

@znerp,

I'll use that script as a test case and work on improving that.

1 point
login to vote
Posted Aug 13, 2008

Good job guys! Thanks--GD

1 point
login to vote
Posted Aug 28, 2008

this was very noticeable in a script updater i have... I really thought it was broken because it was fetching things too fast :)