We use cookies to improve your experience. No personal information is gathered and we don't serve ads. Cookies Policy.

ExpressionEngine Logo ExpressionEngine
Features Pricing Support Find A Developer
Partners Upgrades
Blog Add-Ons Learn
Docs Forums University
Log In or Sign Up
Log In Sign Up
ExpressionEngine Logo
Features Pro new Support Find A Developer
Partners Upgrades
Blog Add-Ons Learn
Docs Forums University Blog
  • Home
  • Forums

Weird bug with Feedgrab/Magpie and duplicate entries

Development and Programming

beep's avatar
beep
25 posts
17 years ago
beep's avatar beep

So I’ve been playing around with FeedGrab to pull in content from other sites (namely, del.icio.us and Flickr) to create a sort of tumblelog. However, I came across something weird: for some reason, three links from my del.icio.us feed kept getting duplicated each time I ran FeedGrab.

After awhile, I found out that the three links all had two things in common: they had query strings with URL variables, and the local copy of the URL (stored by FeedGrab in EE) differed from del.icio.us.

Basically, the URL from my del.icio.us feed would look like:

http://www.nowherelimited.com/catalog/index.php?main_page=index&cPath=104

But once FeedGrab pulled it down, it got turned into:

http://www.nowherelimited.com/catalog/index.php?main_page=index&cPath;=104

Note the extra semi-colon (“;”) after (“&cPath;”). For whatever reason, either FeedGrab or Magpie converted the URL variable “cPath” into a character entity, and stored that in EE. So when the template containing the plugin was run again, the local version of the URL wouldn’t match the one in my del.icio.us feed, and a new entry was created.

Once I figured out what was causing the extra entries to pop up, I fixed the issue by manually editing the local URLs to match the ones in my RSS feeds. But despite that, is there something different I should be doing with FeedGrab? My code’s below:

{exp:feedgrab url="http://del.icio.us/rss/XXXXXXXX"
weblog="3"
title="title"
date="dc:date"
use="link|description"
fields="link_url|link_description"
unique="link_url"}

{exp:feedgrab url="http://api.flickr.com/services/feeds/photos_public.gne?id=XXXXXXXX"
weblog="2"
title="title"
date="dc:date.Taken"
use="link|media:content@url|media:thumbnail@url|guid"
fields="flickr_url|image_url|thumb_url|image_guid"
unique="image_guid"}

Any help you could give would be appreciated. Thanks!

       
Sue Crocker's avatar
Sue Crocker
26,054 posts
17 years ago
Sue Crocker's avatar Sue Crocker

Feedgrab is a third party offering, I’m going to move you over to the Plugins forum.

       
beep's avatar
beep
25 posts
17 years ago
beep's avatar beep

Thanks, Sue. I didn’t know if this could be an issue with Magpie, though, which is why I posted it in the other thread.

Oh, and /bump ;)

       

Reply

Sign In To Reply

ExpressionEngine Home Features Pro Contact Version Support
Learn Docs University Forums
Resources Support Add-Ons Partners Blog
Privacy Terms Trademark Use License

Packet Tide owns and develops ExpressionEngine. © Packet Tide, All Rights Reserved.