Scaling Livejournal using MySQL

brad (LiveJournal founder), seems to have made a kickass presentation about LJ at MySQL Users Conference. If your work involves databases and load-balancing , then you *must* check out his slides. Jeremy has a nice write-up on the talk as well.

I put up the ljimages thingy on my site. Its ADDICTIVE.

17 Comments

  1. teemus · April 14, 2004 Reply

    LJImages is khool! (Admire your ideas dude!)

    Mindblowing talk by . Simply WOW.

  2. ideawerkz · April 15, 2004 Reply

    yes, didn’t know u r with yahoo.

  3. ideawerkz · April 15, 2004 Reply

    What is the algorithm behind ljimages? you grab recent pictures of your friends or a community?

  4. Anonymous · April 15, 2004 Reply

    It more like – there is a site http://rtns.org/ljimages/ – and happened to find it. It can be attributed to either the existense of very good search engines OR a good social network.

  5. Anonymous · April 15, 2004 Reply

    The above comment was posted by the dumbest idiot known to mankind. 🙂
    *sorry*

  6. ideawerkz · April 15, 2004 Reply

    then i must have misunderstood his post.

  7. admin · April 15, 2004 Reply

    The site is mine and I write the script. But the Idea is not mine. Livejournal offers an API ( http://www.livejournal.com/stats/latest-img.bml ). I just pick the stuff and display the images on a single page.

  8. ideawerkz · April 15, 2004 Reply

    I was browse the homepages, besides mine, and I found http://puggy.symonds.net/~kalyan/. Yours?

  9. admin · April 15, 2004 Reply

    yep. its my old site before I got myself a domain name. I used to maintain it in my college days.

  10. premshree · April 15, 2004 Reply

    Oh, I was just wodering, how the hell could you be using the latest posts RSS…:-)

  11. teemus · April 15, 2004 Reply

    Possible…

    http://www.livejournal.com/stats/latest-rss.bml + reg-exps + Perl/PHP could do the trick as well I guess…

  12. premshree · April 15, 2004 Reply

    Re: Possible…

    Of course it’s possible. But the latest-rss file would be huge to handle. At one time, it was around 400kB.

  13. admin · April 15, 2004 Reply

    Re: Possible…

    The rss file is just filled with links to the images. So the file itself is less then 10kb.

  14. premshree · April 15, 2004 Reply

    Re: Possible…

    You mean the file generated using the script, right? But, processing the latest-rss file would take longer than the latest-img file…much longer.

  15. hserus · April 16, 2004 Reply

    thanks for the slides link – its rather interesting (not to mention useful – we use mysql rather extensively, and in fairly similar ways to what the slides describe)

Leave a Reply