kypeli ([info]kypeli) wrote in [info]lj_dev,
2012-02-08 16:56:00
  • Previous
  • Memorize
  • Share
  • Next

Downloading comments

Hi all,

In order to process blog content for some academic research, I would need to download the comments for an article. I can already download the articles (by scraping the lightweight version of the article), but I am not quite sure how to download comments. One problem being that some comments must be expanded by clicking on a link before they are visible.

Are there any solutions available on how to download comments for public blog posts?

  • Post a new comment

    Error

    Anonymous comments are disabled in this journal

    switch

    Your reply will be screened

    Your IP address will be recorded 

     
    Help
  • 3 comments

[info]foxfirefey

February 8 2012, 16:31:58 UTC 3 months ago

I don't know how to do it other than scraping, but looks like view=flat still works as URL argument to unthread all the comments adn that way you would not have to click to expand since nothing would be collapsed.

[info]kypeli

February 8 2012, 17:10:46 UTC 3 months ago

Thanks a lot for this hint! It helps a lot. I think I now can scrape the comments. :)

[info]pw201

February 8 2012, 17:21:31 UTC 3 months ago

There's an undocumented getcomments method in the LiveJournal API which allows you to download comments. Whenever I use it, it just gives me all the comments on a post. I may have some sample code somewhere, though I can't reach my home machine at the moment.

There's also the existing export stuff, but I think that only works on your own journal.
Create an Account
Forgot your login or password?
Facebook Twitter More login options
English • Español • Deutsch • Русский…