Indesign data merge and a very arge csv file

Hello all,
I have a bit of an issue with data merge. I have about 35 product sell sheets, all with the same categories. I am trying to do this via data merge in indesign (ind cs6). Now the csv file that I am using is very large. It has about 75 columns in it. Some of the columns have a lot of text like the ingredients for each product which can be up to 200 words or more. My problme is that when I create a merged documnet I am only getting the first 6 columns to populate the document.
I have tried everything: taking out all myspaces in the header rows, eliminating all the empty columns etc. Funny thing is when I delete the first 6 columns and try again, the next 6 will populate just fine.
Is there some sort of column imit in the csv file?
I cannot figure this out for the life of me and have read every forum I can get my hands onbut they all seem to talk about business cards, envelopes or building a simple catalog template, nothing that includes this much information to be merged.
Any help at all would be greatly appreciated, thank you.
Mike

SAUTEED VEGETABLE PUREE MIX (CARROTS, ONIONS, CELERY), SALT, SUGAR, MALTODEXTRIN, CORN OIL, LESS THAN 2% OF AUTOLYZED YEAST EXTRACT, WATER, POTATO STARCH, XANTHAN GUM, NATURAL FLAVORS, CARROT JUICE CONCENTRATE.
the text above is what comes through in the ingredients in one of my data rows. It's the last thing that works out of the 6 columns that are getting carried over properly.
so you're saying to replace all the long text with breaks with something like "ingtxt" then do a find and replace? I'll try that.

Similar Messages

Is there a way to name the .indd files created by a data merge with values in the CSV file

I have a data merge document that is set to single Record per Document page and 1 page per document. In my CSV file I have a field for Part Number. If I run a data merge with 10 records I end up with 10 .indd files. I need a way so that the resulting .indd files are named the same value that is in the Part Number field.

Loic has provided a link for my original piece, and I've written up some follow-up pieces for indesignsecrets.com:
http://indesignsecrets.com/data-merging-individual-records-separate-pdfs.php
http://indesignsecrets.com/data-merging-individual-records-separate-pdfs-part-2-scripting. php
So there are several ways to get unique name PDFs from an indesign Data Merge. However, none of these 3 articles will truly answer your question of how to get unique indesign filenames using the database. I can see a practical purpose for this as merging business cards directly to PDFs is great, but I can be guaranteed that while on proof, there will be alts to the business cards that need to be done outside the merge, meaning specific records need to be exported to indesign files for further manipulation.

Indesign Data Merge Scripts

I am looking to create a script that will enable me to feed in variable data from a csv to indesign data merge. I have the components built, with a column for quantity in the csv. Our printing needs vary day by day, so multiple records don't quite fit w

Thanks SDesigns; the GREP feature in particular looks like it might work, assuming I can get the data to merge with a separator between each company. That's where I'm having trouble now; I can't seem to be able to merge a particular column from the CSV that has the company names into a paragraph of text within my document, as it only seems to let me merge in the first company name only. Do you know how I can achieve this, and additionally how I can get it to automatically insert any particular separator (as there are hundreds if not thousands of company names, manually typing in the separator could get very tedious)? Attached is a screenshot of what the final text looks like in the document, though it doesn't seem to let me "Update source" on the paragraph, which would make things much easier.Thank you very much for your time and help!
Best,
Colton

InDesign Data Merge Question....

I have a calendar created using the data merge feature within InDesign. The only question I have thus far is on each day of the week, we currently have a text frame linking to a .txt file that our customers add events to. How do I link the specific .txt files to the frame? I cant use the image function in my excel file as it does not reconize it as that. Is there another way to script/put this in my source file to link and place the text in the .txt files (individual txt files for each day of the year).?? Any help would be appreciated. Thanks!

I don't think I really undertand the structure of the data file you have. My sense, though is that this may not really be a data merge project.
At its heart, Data Merge is is very primitive. It's great for mailing labels, but can get defeated by more complex projects. For the merge to work, all of the data must be structured the same for each record in terms of the number of fields, and the text you want to include needs to be in the fields (as far as I know, you cannot use a pointer to an external text file in a field the same way that you can use a pointer to an image). You have a choice when setting up the merge template, though, of putting the plceholders on the document page or on the master page.
If you put the placeholders on the master page, the data can be updated AFTER the merge, at least in theory (doesn't seem to work well with images), but it doesn't really sound to me like that's what you need, but it is a possibility if you have a basic documenet and the clients add text later.
In any case, if you are letting the client add text, you need to add that text directly into your data file, either in Excel and re-export the entire data set, or set up some sort of find/change routine to replace tags in the text file with the text supplied by the client.

Best data Structor for dealing with very large CSV files

hi im writeing an object that stores data from a very large CSV file. The idea been that you initlize the object with the CSV file, then it has lots of methods to make manipulating and working with the CSV file simpler. Operations like copy colum, eliminate rows, perform some equations on all values in a certain colum, etc. Also a method for prining back to a file.
however the CSV files will probly be in the 10mb range maby larger so simply loading into an array isn't posable. as it produces a outofmemory error.
does anyone have a data structor they could recomend that can store the large amounts of data require and are easly writeable. i've currently been useing a randomaccessfile but it is aquard to write to as well as needing an external file which would need to been cleaned up after the object is removed (something very hard to guarentee occurs).
any suggestions would be greatly apprechiated.
Message was edited by:
ninjarob

How much internal storage ("RAM") is in the computer where your program should run? I think I have 640 Mb in mine, and I can't believe loading 10 Mb of data would be prohibitive, not even if the size doubles when the data comes into Java variables.
If the data size turns out to be prohibitive of loading into memory, how about a relational database?
Another thing you may want to consider is more object-oriented (in the sense of domain-oriented) analysis and design. If the data is concerned with real-life things (persons, projects, monsters, whatever), row and column operations may be fine for now, but future requirements could easily make you prefer something else (for example, a requirement to sort projects by budget or monsters by proximity to the hero).

Would installing Cheetah or Raptor drives make inDesign data merge work faster?

Would installing Cheetah or Raptor drives make inDesign data merge work faster?

I think SSDs might turn out to be slower. There are some other posts about major slowdowns when the OS and user profile are on SSDs.
As a 32 bit program, ID can't adress all that extra RAM, so you won't affect the amount of swapping required. I don't really know how efficient an SSD is for constant read and write operations, but my undertanding is they work great for fast loading of things that don't change, but not so much for files that rewrite constantly.

InDesign-Data Merge, Consecutive Empty Fields

Hi there,
I've been doing data merges in InDesign for quite some time now and I've always had this problem. I don't know of any other way, besides to go in and manually delete every line, to get rid of this issue.
Here's my data block:
<<First Name>> <<Last Name>>
<<Spouse First>> <<Spouse Last>>
<<Address 1>>
<<Address 2>>
<<City>>, <<St>> <<Zip>>
Normally, I can just combine address 1 and address 2 into one line separated by a space and it's no big deal. I've tried using the merge option to delete the empty line, but it has never worked properly.
My main concern is the second line. Not all records have a spouse associated with them and when merged, I have to go in an manually delete the entire line. Is there a way to fix this?

I've tried using the merge option to delete the empty line, but it has never worked properly.
That's odd; it's pretty much exactly what you are asking after. Can you tell us anything outside of "it has never worked properly"?
Is there anything non-standard about your merge? (I.e. unusual text encoding, images, master pages, n-up merges, et cetera.) Can you take screenshots of your merge dialogs? Or give us a step-by-step rundown of what you are doing? Are you previewing before merge?
I am an infrequent but long-time user of Data Merge, and I've always been able to use the "Remove blank lines for empty fields" checkbox without issue.

InDesign Data Merge using password protected PDFs?

I am trying to print postcards with Data Merge and I've run into a problem. The source files for one of the images are password protected PDFs. They all use the same password, and I do know the password, but InDesign wants me to enter the password every time it processes a record.
If I'm printing 10,000 postcards, I would have to enter the password 10,000 times to make my merged file!
Does anyone have any suggestions? Is there a way to enter the password once and, maybe hold down [command + option + control + kitchensink] or whatever, while clicking "OK" to apply that password to all future password dialog boxes? Is there a script I can run that could automatically enter the password?
The original source PDFs need to keep the password protection, so removing the security en masse isn't an option. Making non-secure copies of all the possible PDFs that could be used seems really unwieldy and would take up a lot of network storage resources, so I really hope there is a more elegant solution out there.
I'm using CS5 on a Mac and I would LOVE it if anyone has any suggestions at all on how to fix this. Thanks!
-Cole Hartson

Your path needs to use a colon instead of a forward slash. Also you might need to add the name of your hard drive before Users.
The easiest way to get the correct path is to manually place one of the images, then go to the links panel, right-click on the image name and select Copy Info > Copy Platform Style Path.

InDesign Data Merge / Image Frame Options

Hi! I am learning Data Merge and am trying to set-up some product sheets using it. I have done pretty well so far but have an issue with the way images are importing into the different image frames. There are a few different image frames on the layout (main product image, tech drawing, tech icons, etc.), and I need each image frame to have different frame options set.
So far using the general "Frame Fitting Options" for each has worked for all imported images except for my tech icons (which I can get to import correctly if I choose "Content Placement Options > Fit Frames to Images" from the Data Merge side menu --but when I do this, it applies to all image frames on the page and not just the one selected (which does not work overall).
Is there another option to get the icon image frames to "Fit Frame to Image" automatically without using the Content Placement Options from the Data merge menu? Is there a way to use the Content Placement Options so it works for individual frames vs all on the layout?
Any help is much appreciated!
Liz

Within the data merge, the frame fitting options apply to all frames that contain variable images, so if you want one variable image to fit image to frame, and another variable image to preserve its size, that cannot be done in the main file, but by manipulating the resulting merge file as P Spier suggests. With Data Merge, there are 8 ways an image can fit inside a frame - see the linked pdf: http://colecandoo.files.wordpress.com/2012/08/framefit.pdf
This is further complicated when importing ai or pdf images that contain different possible sizes to import (e.g. trim box, bleed box, bounding box, etc). If the "show import options" dialog box is used when placing an image into a data merge file, the settings used in those import options are maintained in the file for the importing of any pdf/ai files via the data merge. What this means is that a data merge containing pdf/ai images can go haywire quickly if the import options change.
There are some tricks that can be used to control a size of an image in a data merge, provided the images are pdf/ai. If images are being placed by bounding box size in the import options, a way is by drawing a no fill/stroke box behind (or on another layer) of the pdf/ai - this will be used to define the actual size of the image, instead of the top left/bottom right of the image. Similarly, if images are being placed by media box, a similar technique can be used by making the illustrator artboard the size used to define the incoming image size.
There are also other ways to control the way an image grows/shrinks when importing via the data merge. I have written about that elsewhere, but the trick relies on using making the variable image an anchored object in a larger text frame and controlling its coordinates with text and textbox formatting (e.g. top/bottom/center align; left/right/center, or tab position): Centering “fit frame to images” using InDesign CS6 | Colecandoo!

Multiple records in Indesign Data merge

When I select the option for multiple records in InDesign Date Merge, I still only get one record on a page in preview. When I ask it to create a merged document, each item from the excell file is put on a separate page. Why is this happening, I want 4 items on a page.

Message was edited by: p_lue
I figured out the problem. The margins would have to be smaller for the page to accomodate multiple records. Thanks for offering to help.

HELP I am doing a Data Merge and It is only giving me one record per page!

I really need help here. I am doing a data merge and have selected the options for doing multiple records per page but instead it is merging everything to it's own page. Can someone tell me what I am missing?

Why do you say you can't do a multiple record merge to a table?
I've never had any trouble putting placeholders into a table. It's the way I do most of the datamerge that I work with.
My mistake… I was confused with the script, and I must confess I had never tried (until now) to use tables as placeholders, but it works.
My apologies for this uncorrect answer

Import data from oracle database table into csv file

Hi
I have to import data from a table into a csv file. Could anyone suggest the best method to do it? My application is JSP as frontend and have put business logic in servlet.
Thanks in advance.

FastReader from wisdomforce will help you quickly export data into csv file. http://www.wisdomforce.com
fastreader can be called and executed as an external process ( Runtime.exec(..) ) to extract data from Oracle tables into flat file

By using OID how to unzip the folder and load bunch of .csv files

Hi All
bellow is the my scenario.
in my scenarion we have created FTP folder that will load the .zip files(Every Day).
.zip files that will contain bunch of .csv file (flat files) and by using OID need to extract the .zip file and load the all .csv files into target database. source data is .csv files and target data is oracle10g. Dose it will possible by using ODI?? please suggest me...
Thanks in Advance
Zakeer

Hi,
i'm interrested on this way of reading multiple files, i tried to follow those steps but i'm getting an error while running the package:
ODI-1226: Step vReadFile fails after 1 attempt(s).
ODI-1236: Error while refreshing variable VOUCHER_CUSTOMER_DATA_INTEGRATION.vReadFile.
Caused By: java.lang.NumberFormatException: For input string: "#Activity_report_name"
the variable vReadFile can't recognize the other variable Activity_report_name.
the refreshing query for vReadFile is :
select file C1_FILE
from TABLE
/*$$SNPS_START_KEYSNP$CRDWG_TABLESNP$CRTABLE_NAME=files_namesSNP$CRLOAD_FILE=C:\/files_name.txtSNP$CRFILE_FORMAT=DSNP$CRFILE_SEP_FIELD=0x0009SNP$CRFILE_SEP_LINE=0x000D0x000ASNP$CRFILE_FIRST_ROW=#Activity_report_nameSNP$CRFILE_ENC_FIELD=SNP$CRFILE_DEC_SEP=SNP$CRSNP$CRDWG_COLSNP$CRCOL_NAME=fileSNP$CRTYPE_NAME=STRINGSNP$CRORDER=1SNP$CRLENGTH=50SNP$CRPRECISION=50SNP$CRACTION_ON_ERROR=0SNP$CR$$SNPS_END_KEY*/
any suggestion plz
regards

Insert Data into Table from TXT or CSV file !!!!!

Dear All,
Recently I have started working on APEX. In Oracle Forms, we used to use TEXT_IO for inserting records into tables from txt files. Now I want to do the same thing in apex 3.2. How can I insert data into tables from txt of csv files.
Waiting of your valuable suggestions.
With kind regards,
Yousuf.

Yousuf
wwv_flow_files is used by APEX to hold uploaded files.
If you incorporate a file browse item on you page, browse for the selected file, then submit the page (having the PL/SQL process described as an on suibmit process) then what I detailed should work.
If you don't need users to have access to this then just go to Home>Utilities>Data Load/Unload in APEX and there is a handy load utility there that does it all for you.
Cheers
Ben

Why does an InDesign document exported to PDF using data merge result in very different sized PDFs?

I've got a small sheet that I update on occasion and use data-merge to add people's names to the sheet. It's very much like an invitation where every invite has a different name on it. I use the data merge feature to select a list of names and then they get inserted into the document. Then I use the Export to PDF command in the data merge window to create a pdf that has all of the invitations in one big file. They are four-up per page on letter sized paper. Sometimes I print 2000 of them and the resulting PDF is about 2mb, sometimes I print 1000 of them and it's 20mb. Document, settings, method of issueing the commands to output the files are all the same. The only difference is the list of names and those are all almost identical in length. Anyone know what could be happening?
One clue is that it takes about a minute to run when the result is going to be a small file and about 5 or more minutes when the result is going to be a large file.
My guess is that sometimes it includes a copy of the images once per page, and sometimes it only includes them once per document, but I'd love to know why and how to control that. Thanks.

And you verified that the links panel shows everything as up-to-date?
The only other things I can suggest at the moment are the standard two trouble shooting steps: Remove minor corruption by exporting and Replace Your Preferences

Indesign data merge and a very arge csv file

Similar Messages

Maybe you are looking for