How to fix the length of the output file

Question

hi,
I have 1000 records in my source table which need to be inserted into file. But the length of the rows in my file should be only 500 i.e there should be two files getting created for this 1000 records i.e my each output file should contain only 500 rows not more than that.
Depending on the number of records present in the source, the file getting created will be varying as my file should contain only 500 rows each. for ex: if 5000 rows are present then 10 files need to be created.
How this can be achieved in ODI.
Thanks in advance

Answer 1

I believe this can achieved using jython easily .
Here is a sample output code
Command on Source - Select database Technology and required logical schema
Command on Target - Jython
import java.sql as sql
import java.io as io
import string,re
import java.lang as lang
import java.text as text
myCon = odiRef.getJDBCConnection("SRC")
myStmt = myCon.createStatement()
my_query="SELECT * FROM  SCHEMA.TABLE_NAME "
file_count=1
i=1
myRs = myStmt.executeQuery(my_query)
writer=io.BufferedWriter(io.OutputStreamWriter(io.FileOutputStream('c:\\FILE_'+str(file_count)+'.csv')))
md=myRs.getMetaData()
collect=[]
while (i<= md.getColumnCount()):
    collect.append(md.getColumnName(i))
    i+=1
header=','.join(map(string.strip,collect))
#writer.write(header+'\n')
myRs = myStmt.executeQuery(my_query)
md=myRs.getMetaData()
myRs.setFetchSize(5000)
i=0
while (myRs.next()):
    j=1
    col=[]
    while (j<= md.getColumnCount()):
        col_type=md.getColumnTypeName(j)
        col_name = myRs.getString(md.getColumnName(j))
        if col_name is None:
            col_name= ''
        col.append(col_name)
        j+= 1
    data=','.join(map(string.strip,col))
    writer.write(data+'\n')
    #print data+ '\n'
    i +=1
    if (i == 500):
        writer.flush()
        writer.close()
        file_count +=1
        writer=io.BufferedWriter(io.OutputStreamWriter(io.FileOutputStream('c:\\FILE_'+str(file_count)+'.csv')))
        i=0
writer.flush()
writer.close()
myCon.close()Please run this code and let me know if you need any other help or modification to get your desired results.