Plugin: CSVGrab

Actually, “save with type unicode text (*.txt)” might be what you are looking for.

Hmmmm… I only have the option to save as unitext utf-16. And I see no big difference. If I upload the problem remains.

How does that textfile know it is unitext? 🐛

Sue: I have a new version of CSVGrab (& Feedgrab) that obeys the Multiple Site Manager settings - I’ll hopefully release it very soon once tested. DEA: it does not respect the parent category setting at the moment, but it is on my to do list…

Ah, thanks. Any idea of when you’d be doing that part?

I’ve succesfully imported more than 3,000 entries using the following code:

{exp:csvgrab url="http://www.domain.com/grab/memberlist-OG-25-04-2008.csv"
                          site_id="4"
                          weblog="26"
                          title="2"
                          delimiter="TAB"
                          encloser="QUOTE"
                          use="1|8|3|4|5|6|7"
                          fields="member-number|member-type|MAddress1|MAddress2|MAddress3|MAddress4|MSubRegion" }
}

However when I go to view entries in a template I get the following:

Bob SMITH {member-number} {member-type} {MAddress1} {MAddress2} {MAddress3} {MAddress4} {MSubRegion}

None of my custom fields seem to be rendering. I have checked all associations and groups and they are correct. If I manually enter data then the entry displays correctly:

test name 10010 Member test test test test test

The template code i am using is:

{exp:weblog:entries weblog="{my_weblog}" limit="100"}

<div class="entry">

<h2>{title}</h2>

{member-number} 
{member-type} 
{MAddress1} 
{MAddress2} 
{MAddress3} 
{MAddress4} 
{MSubRegion} 

</div>

{/exp:weblog:entries}

Any ideas on how to fix this greatly appreciated.

Nardog, the plugin is not site aware. There isn’t any code in the current version of the plugin to actually set the right site_id.

Edit one of these entries in the back end to use site_id = 4 instead of site_id = 1 and see if it fixes that particular one.

Disclaimer: Unless Andrew modified the plugin in the last few days..

Hi Sue,

Thanks for replying. I understood from Andrew’s site that site_id= does work.

Step 5: Set up the import template and plugin Create a new template called go and add the call to the plugin: {exp:csvgrab url=”http://ee.bnb-dev.co.uk/grab/golf.csv” delimiter=”,” encloser=”QUOTE” site_id=”2” weblog=”4” category_group=”2” title=”2” category_field=”3” use=”7|8|9|10|11” fields=”golf_addr|golf_city|golf_state|golf_zip|golf_phone” unique=”golf_phone” }

In my case the import worked fine but the problem is with the display of the custom fields. When I check a random entry in the CP edit tab all the fields are populated correctly. Yet when I view that entry through the template the custom fields do not display although they are present in the entry.

Good, he’s changed it then. 😊

Is that all you have in the template? What happens if you reduce the template to just the exp:entries tag (hard coding the weblog field name).

Hi Sue,

That is all I have in the template and I have tried hard coding the the weblog field name. What’s wierd is that the content is all there in the CP yet the template does not pick up the custom fields unless the entry was manually entered rather than imported with csvgrab.

This is weird. All of a sudden CSVGrab only processes around 1400 entries at a time before quitting on me. Each time, it ranges from successfully processing anywhere from 1390 to 1410 or so. Any clues on that one?!

Running out of memory? Turn on error reporting, and/or check the logs.

From the error log:

PHP Warning: Cannot modify header information - headers already sent by (output started at /var/www/vhosts/domain.com/httpdocs/system/plugins/pi.csvgrab.php:577) in Unknown on line 0

Edit: Also, I had the PHP mem_limit set to 128M

So, why is it only kicking in after 1400 entries? Are those imported fine? The “connot modify header inforamtion” error is quite often caused by additional whitespace at the beginning of your plugin or code, you might want to check that.

That’s what’s so strange. Not sure where to start looking in the code as it’s the CSVGrab plugin. Maybe I’ll reupload it and see if that does anything…?

Can’t hurt. What I meant was making doubly sure that <?php is in the first line of the plugin, and not perhaps a linebreak or so. It’s happened to me. If that does not help, yes, re-uploading a fresh version certainly would not hurt.