Comments on: Parsing XML CJ Product Feeds http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/ Coding For Online Success Wed, 15 Jun 2011 08:44:43 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: onlineshop http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-1039 onlineshop Wed, 15 Jun 2011 08:44:43 +0000 #comment-1039 can you suggest store script that can handle the cj datafeed? thanks can you suggest store script that can handle the cj datafeed?
thanks

]]> By: NexWeb http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-1011 NexWeb Sun, 20 Mar 2011 14:29:24 +0000 #comment-1011 Acually, oops, we have just implemented the MySQL version at the same URL , which is much faster. Acually, oops, we have just implemented the MySQL version at the same URL , which is much faster.
NexWeb´s last [type] ..Ecommerce Website ASPNET Shopping Cart System

]]> By: NexWeb http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-1010 NexWeb Sun, 20 Mar 2011 09:41:47 +0000 #comment-1010 We have implemented a cj XML feed parser in ASP.NET. An example of which is at: http://eastgrandlake.com/fishing-shop/ Depending on the merchant, the XML files tend to be large > 30 megs. We are about to release a MYSQL version to better work with the data and increase the performance. We have implemented a cj XML feed parser in ASP.NET. An example of which is at: http://eastgrandlake.com/fishing-shop/
Depending on the merchant, the XML files tend to be large > 30 megs. We are about to release a MYSQL version to better work with the data and increase the performance.
NexWeb´s last [type] ..Ecommerce Website ASPNET Shopping Cart System

]]> By: rick http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-902 rick Mon, 30 Aug 2010 00:05:14 +0000 #comment-902 HI still confuse about 1111111_11111_20090528.xml . on the cj ftp I have product catalogs with 5 digit numbers and within each catalog there are dozens of advertisers of course for the life of me I cannot locate the above numbers anywhere. Whee do you get the above numbers relating to an advertisers xml feed on cj's ftp? HI

still confuse about 1111111_11111_20090528.xml . on the cj ftp I have product catalogs with 5 digit numbers and within each catalog there are dozens of advertisers of course for the life of me I cannot locate the above numbers anywhere. Whee do you get the above numbers relating to an advertisers xml feed on cj’s ftp?

]]> By: rick Sarouk http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-901 rick Sarouk Sun, 29 Aug 2010 23:50:37 +0000 #comment-901 Currently I am running localhost server on my computer experimenting with my worpress blog and other site. I have downloaded all feeds to my c drive folder. When you say transfer it to a working directory? what does that mean? Are you saying creating a database on the server? This is the part of your comment I am trying to understand. "This is assuming that you’ve already FTP’d the XML to your working directory. Again, let me know if you need this process as well, and I can provide some examples." By the way incredible post and thanks for the help. Currently I am running localhost server on my computer experimenting with my worpress blog and other site. I have downloaded all feeds to my c drive folder. When you say transfer it to a working directory? what does that mean? Are you saying creating a database on the server?

This is the part of your comment I am trying to understand.
“This is assuming that you’ve already FTP’d the XML to your working directory. Again, let me know if you need this process as well, and I can provide some examples.”

By the way incredible post and thanks for the help.

]]> By: Kadimi http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-898 Kadimi Sat, 21 Aug 2010 22:42:14 +0000 #comment-898 When dealing with large files it's better to use XMLreader. SimpleXML is not practical for big file since it loads files to memory before processing them (It's a tree-based parser). XMLreader uses another approach (It's a stream-based parser), so you should get the job done easily with XMLreader Read http://www.ibm.com/developerworks/xml/library/x-xmlphp2.html When dealing with large files it’s better to use XMLreader.

SimpleXML is not practical for big file since it loads files to memory before processing them (It’s a tree-based parser).

XMLreader uses another approach (It’s a stream-based parser), so you should get the job done easily with XMLreader

Read http://www.ibm.com/developerworks/xml/library/x-xmlphp2.html

]]> By: Kevin http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-832 Kevin Tue, 16 Mar 2010 17:48:16 +0000 #comment-832 Would it be better to use xmlreader for a task like this? I've steered clear of using simplexml with cj feeds because these feeds can be very big and simplexml loads everything to memory -- but maybe my understanding isn't clear? Would it be better to use xmlreader for a task like this? I’ve steered clear of using simplexml with cj feeds because these feeds can be very big and simplexml loads everything to memory — but maybe my understanding isn’t clear?

]]> By: markowe http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-698 markowe Fri, 25 Sep 2009 17:45:45 +0000 #comment-698 P.S. Oops, the tag I put after "I would have expected ROWS IDENTIFIED BY ..." got stripped out - I meant to write a "product" closing tag. .-= markowe´s last blog ..<a href="http://www.storeminator.com/news/The-Zune-goes-HD--preorder-now_17" rel="nofollow">The Zune goes HD - preorder now!</a> =-. P.S. Oops, the tag I put after “I would have expected ROWS IDENTIFIED BY …” got stripped out – I meant to write a “product” closing tag.
.-= markowe´s last blog ..The Zune goes HD – preorder now! =-.

]]> By: markowe http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-696 markowe Fri, 25 Sep 2009 08:35:22 +0000 #comment-696 Cool stuff, thanks for this. When we chatted on DP you mentioned that you didn't think even large files would be a problem with this method - so you think doing a simplexml_load_file on an XML of, say 200Mb, with maybe 150,000 distinct items, wouldn't place that much of a load on the server, or on memory? Mind you, the second method, with LOAD XML LOCAL INFILE, seems a lot neater, and I guess that would be very fast. I am not clear exactly how it works though - I guess it is creating a unique table entry for each ITEM, but what have you specified as ROWS IDENTIFIED BY? It just looks like some whitespace. I would have expected ROWS IDENTIFIED BY ""? Also, I am not clear what happens when you have nested XML - there is none in CJ XML, but what about Amazon, say? How does LOAD XML handle a hierarchy of data? It would be nice if it created related tables on its own initiative, obviously :) .-= markowe´s last blog ..<a href="http://www.storeminator.com/news/The-Zune-goes-HD--preorder-now_17" rel="nofollow">The Zune goes HD - preorder now!</a> =-. Cool stuff, thanks for this. When we chatted on DP you mentioned that you didn’t think even large files would be a problem with this method – so you think doing a simplexml_load_file on an XML of, say 200Mb, with maybe 150,000 distinct items, wouldn’t place that much of a load on the server, or on memory?

Mind you, the second method, with LOAD XML LOCAL INFILE, seems a lot neater, and I guess that would be very fast. I am not clear exactly how it works though – I guess it is creating a unique table entry for each ITEM, but what have you specified as ROWS IDENTIFIED BY? It just looks like some whitespace. I would have expected ROWS IDENTIFIED BY “”?

Also, I am not clear what happens when you have nested XML – there is none in CJ XML, but what about Amazon, say? How does LOAD XML handle a hierarchy of data? It would be nice if it created related tables on its own initiative, obviously :)
.-= markowe´s last blog ..The Zune goes HD – preorder now! =-.

]]> By: admin http://www.money-code.com/2009/06/parsing-xml-cj-product-feeds/comment-page-1/#comment-605 admin Wed, 26 Aug 2009 20:31:01 +0000 #comment-605 I personally like to store results in a database. I do this for a few reasons. In case there is a something wrong with a particular API call (ie: CJ is done, etc) it doesn't break my site. Also, it's much faster accessing a local DB vs making a API call every time. What I do is populate the local database on a set time.. ie: every hour, or once a day, etc. Hope this helps. hanji BTW.. thanks for commenting! I personally like to store results in a database. I do this for a few reasons. In case there is a something wrong with a particular API call (ie: CJ is done, etc) it doesn’t break my site. Also, it’s much faster accessing a local DB vs making a API call every time. What I do is populate the local database on a set time.. ie: every hour, or once a day, etc.

Hope this helps.
hanji

BTW.. thanks for commenting!

]]>