Scholar reference search throws error

[fredcallaway]

This happens as soon as I finish the search e.g. "gsref narwhal mating patterns."

Starting debug for 'Reference Importer'

[2016-08-26 16:36:34][ERROR: input.scriptfilter] Code 1: Traceback (most recent call last):
  File "gscholar.py", line 75, in <module>
    pdflink = pdfdata.a['href']
AttributeError: 'NoneType' object has no attribute 'a'

cref works fine.

[fredcallaway]

I was able to fix this problem myself. Replace gscholar.py with my version, and add scholar.py which is a general purpose library for querying google scholar.

https://gist.github.com/fredcallaway/8deebaabd652a06b5105450588d0d1b1

[sdsy888]

@fredcallaway Hi, thank you for your modification.
However, I still cannot use the gsref command after I replace the origin code with yours.
Nothing happens after I type in gsref test.
Do you have anyidea what the problem is?
Thank you!

[fredcallaway]

I can’t say exactly, but it probably has to do with Google frequently changing the html structure, making existing parsing libraries ineffective. I gave up on this plugin, and am now using Mendeley for automatically getting bibliography information for papers I download. Good luck! On January 11, 2018 at 1:17:44 AM, Neo Song (notifications@github.com) wrote: @fredcallaway <https://github.com/fredcallaway> Hi, thank you for your modification. However, I still cannot use the gsref command after I replace the origin code with yours. Nothing happens after I type in gsref test. Do you have anyidea what the problem is? Thank you! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#6 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AHhJlDKXdaaEJZStLXzV-gXykovl7VAjks5tJdG2gaJpZM4JujTV> .

[andrewning]

The gsref command isn't working, and I probably will just remove it. I dug into it and @fredcallaway is right. Because is no official API for google scholar, the app relied on screen scraping. Unfortunately, this is fragile, especially because google keeps changing the structure. I tried using scholar.py that @fredcallaway suggested, but it has the same problem. The ref and book commands rely on actual APIs and so those should continue to work.

[sdsy888]

Thank you for reply! I also figured out the problem. However, I've encountered the crashing problem with Mendeley: every time I try to add new papers(not single one paper but papers) or import a folder, the application will crash immediately. So do you have encountered this problem on Mac (OSX 10.13.2)? Anyway, thank you for your sharing! On 01/12/2018 03:39，andrewning<notifications@github.com> wrote： The gsref command isn't working, and I probably will just remove it. I dug into it and @fredcallaway is right. Because is no official API for google scholar, the app relied on screen scraping. Unfortunately, this is fragile, especially because google keeps changing the structure. I tried using scholar.py that @fredcallaway suggested, but it has the same problem. The ref and book commands rely on actual APIs and so those should continue to work. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.