| Task | Before | After | Speedup |
|---|---|---|---|
| Startup | 259ms | 336ms | -29% |
| Front page | 237ms | 50ms | 79% |
| First userinfo hit | 398ms | 241ms | 40% |
| Later userinfo hits | 360-380ms | 100-110ms | 72% |
| Talkread | 345-375ms | 140ms | 62% |
| Talkpost | 400-420ms | 140ms | 66% |
Basically, this is going to save us 200-250ms on almost every BML page on the site. Which is huge.
The patch and the README are on my website. The README is also included after the cut.
The purpose of this patch is to move require statements out of BML files
and into lj-bml-init.pl, so we don't eval 2000+ lines of library code on
every hit. This was complicated by the fact that ljlib.pl, the worst
offender for both omnipresence and size, puts some variables in its caller's
namespace, and BMLCodeBlock::* gets swept out after each hit.
All the variables in ljlib.pl outside package LJ were deleted or moved into
package LJ. ljlib.pl includes ljconfig.pl, and so unqualified references to
$SENDMAIL, $IMGPREFIX, $SERVER_DOWN were also changed to the LJ::* form.
I also refactored some of the mail-sending code, so we have send_mail_raw
(localizing the call to sendmail) and send_admin_mail (localizing signoff
and signature text for emails from the LJ system); removed code for and
references to deprecated %monthname, %monthshortname, and %dayweekname;
and fixed a bug on LJ::Lang::enum_trans (upon which the replacement for
those hashes depends).
This patch also includes my previous protocol-groupmask and interest-findsim
patches, for no good reason.
I did not include the commenting out of requires from 100+ BML files in this
patch. So, after applying this patch (with patch -p5), run this command to
do it yourself:
perl -pi.bak -e 's/^/# / if /^\s*require.*(ljlib|ljprotocol|cleanhtml)\.pl/' \
`find /home/lj -name '*.bml' -print`
Possible further work:
Remove the guts of talkread/talkpost (400-500 lines each) and other
frequently hit pages, put them in libraries, stop re-evaling them all
the time. This would probably save us another 30-50ms for those hits.
Learn why we're restarting the FCGI coprocess every 50 hits, see if we
can stop doing so somehow. It's expensive in CPU time and in setting
up new connections with the database.
Make cleanhtml faster.
