Data Transfer Workbench Slow on Large Imports

I am using version 6.5.11 of the workbench, API version 6.50.53
I have a problem with the speed of imports where the file sizes become large. e.g. I am importing sales invoices using a header file and line items file. Both are tab-delimited text files. If I import 2000 invoices, it takes around 1.8 seconds per invoice. If I import 10000 invoices, it takes around 18 seconds per invoice (50 hours). I actually wanted to import around 30000 invoices, but that was taking a minute per invoice.
Another problem is that the first data line after the header line in every import file is ignored and not processed.
Does anyone know if these have been fixed or will be fixed soon?

To import a large amount of items or invoices with the Data Transfer Workbench, I always shrink the file into x files with 1000 records. That's the only to have a fast process.
Apparently this problem is correctedwith 2004 which is much faster. I haven't tested yet the DTW with 2004 as I just received it.
For the bug you have with the line, it occured to me one time too but not anymore and I can't work out why it did that. Maybe, it could be more efficient for you to create message on the marketplace.
Vincent

Similar Messages

  • Issue with Data Transfer Workbench

    I have a simple user-defined object of a type Master Data based on a table with only three fields (Code, Name, U_Remarks).
    When I try to import data to that object using Data Transfer Workbench, it fails to import any of records and gives an error:
    Created Failed, Unknown error - 1005.
    Do you have any idea on this? Thanks in advance.

    Hi,
    See link below:
    Unable to import data in Master Data Type in User Table
    I don't think you can import master data type UDO.
    Regards,
    Nat

  • Error importing Incoming Payments using the Data Transfer Workbench

    Every time I try to import Incoming Payments using the Data Transfer Workbench I get an error that the Update Failed - Can not find this object in B1Application-defined or object-defined error65171. I'm using the 3 templates for Payments, Payments_Checks and Payments_Invoices. I've filled them out as I've seen in other postings in this forum. Based on the error message, I really can't tell what I'm doing wrong. Could someone please take a look at my files and let me know what might be causing the error?
    I'm using SBO 2007A PL41. Here's what I have entered in my templates for my test file.
    Payments file
    RecordKey 1
    DocEntry (blank)
    CardCode 1033985
    DocDate 20081215
    DocTypte rCustomer
    TaxDate 20081215
    Payments_Checks file
    RecordKey 1
    LineNum 0
    AccounttNum 0
    CheckAccount _SYS00000002152
    BankCode CC
    Branch 12345
    CheckNumber 1
    CheckSum 78.7
    CountryCode CA
    DueDate 20081215
    Trnsfrable tNo
    Payments_Invoices file
    RecordKey 1
    LineNum 0
    DocEntry 31791
    InvoiceType 13
    SumApplied 78.7
    Thank you.

    Hi Suda,
    As far as I can tell from the threads you forwarded (and other searches I've done on here), my files are correct. I tried filling out the templates exactly as explained in the first link (see my data below) but it still isn't working. It just gives me the same generic error. 
    Payments
    Record Key....CardCode.....DocDate
    1...................1033985.......20081217
    Payments_Checks
    RecordKey....CheckAccount........CheckNumber....CheckSum
    1.................._SYS00000002152..1.....................  78.7
    Payments_Invoices
    RecordKey....DocEntry.....SumApplied
    1..................31791..........78.7
    Is it correct that the Payments file should not contain anything in the DocEntry column? (I know that the DocEntry in my Invoices file is the DocEntry of the Invoice). I have a feeling that I'm making a stupid mistake somewhere but I just can't figure it out. Any ideas?
    I really appreciate your help with this.
    Thanks,
    Charlotte

  • Importing incoming payments using data transfer workbench

    Hi experts
    I am using data transfer workbench for incoming payments, but incoming receivables are checks.
    I am using three templete files
    1.Payments
    Recordkey Cardcode Docdate
    1                 A0001      21102009
    2.Payments_check
    Recordkey  Lineno  Checkaccount Checknumber  Checksum Duedate
    1                       0               161016                1234                11500        21102009
    3.Payment Invoice
    Recordkey  Lineno  Docentry  SumApplied
    1                     0               616000012      11500
    In the field docentry i am placing the invoice number ,i did tried placing the payment number as well in both the cases i am getting the same error. Invalid document number for rct2.docentry Application defined or object defined error 65171
    What should i do to resolve this error.
    Thanks and regards
    Rohan

    Hi Rohan,
    Document number is usually not the same as your DocEntry.  Run a simple query to find it out:
    SELECT T0.DocEntry FROM OINV T0 WHERE T0.DOcNum = '[%0\]'
    Also the Date format should be YYYYMMDD.
    Thanks,
    Gordon

  • Tranform templateu00B4s Excel files into *.txt for Data Transfer Workbench

    I have some problems transforming the data files to import since Data Transfer Workbench.
    I haven't the extructure of de Excel templates of SAP BO.
    What is more important: I'm transforming the data with Access consults, and I use Access for convert the Excel to *.txt files. So, somebody could tell me another way to do this?

    Hello,
    You can have the structure of all DTW templates in C:\Program Files\SAP\Data Transfer Workbench\Templates.
    They are in csv format, but I think this is more easy to save them in txt format (with tab), because you will be able to use "," in the numbers easily.
    For more help on how to fill the templates, you can have a look at DI API help (in the SDK folder). You will find the explanation of every column of your templates.
    HTH,
    Thibault

  • Trying to add DTW (Data Transfer Workbench) add-on

    Hi Community,
    I am new to SBO and have heard that DTW will help me to load multiple lines of Journal entries from an Excel file. Can you please guide me on
    1) how to purchase/get DTW
    2) install DTW
    3) get the templates for Journal entry
    4) and finally how to load it into SBO.
    All help/guidance is greatly appreciated. Thanks in advance.
    Regards,
    Manoj.

    1) how to purchase/get DTW ---free availably
    2) install DTW - open DTW folder -> Setup.exe >
    Read DTW help document  after that
    3) get the templates for Journal entry
    C:\Program Files\SAP\Data Transfer Workbench\Templates\Templates\oJournalEntries
    where u will find template
    for more detail refer
    C:\Program Files\SAP\Data Transfer Workbench\Templates\Data preparation examples\10. Testcase1_Test Data for Import function\oJournalEntries
    4) and finally how to load it into SBO.
    Read Help Document carefully
    Thanks
    Kevin

  • Journal entries in Data Transfer workbench

    Hi all
    When I try to Upload journal entries with debits and credits using data transfer workbench I get an error says Unbalanced transaction.
    I tried lot of things to change but still no go.
    can someone guide me with this data migration
    thanks
    vinodh kumar

    paste it in note pad and save this sample and open with excel
    RecordKey     LineNum     AccountCode     AdditionalReference     BaseSum     ContraAccount     CostingCode     Credit     Debit     DueDate     FCCredit     FCCurrency     FCDebit     GrossValue     LineMemo     ProfitCode     ProjectCode     Reference1     Reference2     ReferenceDate1     ReferenceDate2     ShortName     SystemBaseAmount     SystemVatAmount     TaxDate     TaxGroup     VatAmount     VatDate     VatLine
    RecordKey     LineNum     AccountCode     AdditionalReference     BaseSum     ContraAccount     CostingCode     Credit     Debit     DueDate     FCCredit     FCCurrency     FCDebit     GrossValue     LineMemo     ProfitCode     ProjectCode     Reference1     Reference2     ReferenceDate1     ReferenceDate2     ShortName     SystemBaseAmount     SystemVatAmount     TaxDate     TaxGroup     VatAmount     VatDate     VatLine
    1     1     110001                              28059     30.01.2009                                        abc pte ltd     abc pte ltd     31.01.2009          110001               30.01.2009                    
    2     2     110002                              50000     23.01.2009                                        abc pte ltd     abc pte ltd     31.01.2009          110002               23.01.2009                    
    3     3     261001                         28059          23.01.2009                                        abc pte ltd     abc pte ltd     31.01.2009          261001               23.01.2009                    
    4     4     261001                         50000          22.01.2009                                        abc pte ltd     abc pte ltd     31.01.2009          261001               22.01.2009
    Edited by: Vinod Kumar on Jul 28, 2009 6:56 AM

  • License server in data transfer workbench

    Dear All Experts/Gurus,
    I have a problem about log on to data transfer workbench (DTW). I don't understand why I must put numbers in license server field before log on to Data transfer workbench ? In the license server field of license administration form, I've seen the license server is words for example jimmymc, then beside it 40000.
    I log on DTW, I fill jimmymc in the license server field but I've got error message:
    "connection to jimmymc has failed. Error code 100000001. Connection with license server failed"
    I don't understand why it succeeds if I fill numbers for example 130.1.2.5:40000, it works successful. What actually the function of license server field ? why could it be different with license server in the license administration form ?
    I apreciate your answer. TIA
    Rgds,

    Jimmy,
    The net-net is that ... the way you log into the DTW as of the 2005A version is different becasue the overall licensing mechanism used by SAP Business One for 2005 changed from what was used in version 2004.  The licensing mechanism now uses CORBA.  This allows connection without having to have an IP Address, but you can still use one as you have seen.  When you install the License Server for Business One, the default connection "port" used and is defaulted to in the License Server is 30000 ... although you can change this to any port not being used.  Again ... the net-net is that is how it works and that is what is now required for connection or use the IP.
    HTH,
    Eddy

  • Data Transfer Workbench can copy sales & purchase modules's data?

    Hi,
    Just wondering that,any way to copy the Sales & Purchase Modules's data from existing company to new company? Copy Express can't do it. But how about Data Transfer Workbench can copy?
    Thanks
    Regards,
    Danny
    Edited by: Danny Gan on Mar 18, 2008 5:21 AM

    Danny,
    How many field from the ORDR or RDR1 have to exported depends on the business logic implemented and what was being used.  No one can really provide a standard set of 5 or 10 fields as you know the clients business better than anyone in the Forum.
    If the Client used User fields then data from the user fields should also be exported.
    The base fields from ORDR would be CardCode, DocDate, DocDueDate, Transpcode (shipping code), SlpCode, GroupNum (Payment terms code), etc.
    Similarly on RDR1, ItemCode, Quantity, Price and any additional row level information that may pertain to their business
    Suda

  • Round values using data transfer workbench

    Hi,
    I'm using data transfer workbench to migrate some data, and some values are being rounded wich generates errors in the system.
    Can sombedoy please help me with this  issue? i'm using sap business one 2005 patch 18.
    Thanks a lot

    Angie did you created the template using EXCEL?
    When you edit templates with MS EXCEL you must make sure that the cell properties are properly configure, because if the cell is configure as a number with no decimal it will round the number, the same goes when the cell is a string, if a cell has a comma it will include double quotes when it saves the excel file.
    Regards,
    WB

  • Data transfer workbench, getting errors do a scheduled ODBC import

    i am trying to schedule and automated import using an ODBC connection, i have setup the connection on my PC and have run the transfer workbench manually using this connection and all is working ok.
    but i have saved this import to an .xml file so that i can schedule the import, but when running this i get the following 2 errors
    "Can not connect to ODBC data source" and "Can not get SQL handler"
    the data source is an oracle 11i database, and i say this works fine when running the import manually using the workbench.
    I have noticed that the .xml file does not have the oracle database password saved in it anywhere, i don't know if this is the problem or not
    any help would be appreciated.
    thanks
    dave

    I think u will get answered frm this link
    Re: DTW and ODBC Connections from Batch File
    also check this link
    DTW and ODBC Connections - Automated process
    Edited by: Jeyakanthan A on Aug 18, 2009 12:55 PM

  • Data transfer very slow on mac pro!! mac H/W unable to fit specifications.

    Hi,
    I am installinginternal disks on the quad mac pro and the transfer ratet in the mac are very slow!!!
    the disks are: barracuda 7200.10 disks, 500 GB. Sta II 300, max ST3500630AS firmware 3.AAE . throughput:300mb.jumpred off to get the 300.
    MAC tells that the QUAD MAC Pro equipment (2x2.66ghz dualcore intel xeon) comes with a 3.Gigabit specification/ 300MB/sec. (Intel ESB2 AHCI, speed: 3.0 Gigabit. AHCI version 1.10 supported)...
    And the benchmarks of the disk ST3500630AS show maximum 80MB/sec and a minimin of 37.3MB/sec, average 63.1 MB/sec. (anandtech tests).
    According to seagate.com the maximum sustained data transfer rate:78MB/s
    but in the mac the reallity is different: I am getting a transfer rate of 22MB/sec!!!!! . with out any application running and only making copy of the files!!!!
    that means that the mac is only providing only 1/3 of the expected transfer rate for the disks..
    so, is there a way that the MAC Pro gets all the normal transfer rate for those disks???
    Is the Quad MAC Pro hardware unable to get the maximum throughput of the disks???
    It seems that the mac is unable to get also the average transfer rate of those disks.. how to correct it???
    thanks a lot
    Alberto
    ps. just for fun: I am getting a faster transfer rate from an old power pc ,and old pc, and firewire 400 and old ide disks!!! (36MB/seg!!!)

    Yup.
    BThe latest Mac Pro are better, so if you have a new or 2 month old unit, Seagate should work, though I think there should be later firmware.
    Some would say those drives take the cake or woRSe.
    http://www.barefeats.com/hard91.html
    SEAGATE PUZZLES
    +Firmware version 3.AEE or later solves the slow sustained large block write speed issue for a single 7200.10 inside the Mac Pro.+
    +The remaining performance issue is slow small random read speeds for one, two, three or four drives. No matter how many drives you configure in RAID 0 sets, the average random read speed for combined block sizes from 64K to 1024K is less than 30MB/s (based on QuickBench 3 testing).+
    +Until Seagate fixes this, we can't recommend the 7200.10 series as the ideal boot drive for the Mac Pro (or Power Mac).+
    http://www.barefeats.com/quad08.html

  • SBO 9.0 OEDG/EDG1 Data Transfer Workbench templates?

    Hello Experts,
    I was wondering if there are templates to import Discount Groups in SBO 9.0. Im refering tot the OEDG and EDG1 tables, I checked the examples and included templates but found none. Nonetheless there is an option to upload data in the Data Transfer Workbech Menu.
    Thanks in advance.

    Hi,
    Please check with SAP support.
    Thanks & Regards,
    Nagarajan

  • SAP B1 Data Transfer WorkBench : Data too large for field65171

    hi, i try uploaded the Business Catalog Number using DTW but i got this error :
    Data too large for field 65171 .
    wat does it mean and what is the solution ?
    my .csv file :
    ItemCode     CardCode     Substitute     DisplayBPCatalogNumber
    ItemCode     CardCode     Substitute     ShowSCN
    #12(ItemCode),     euro(CardCode)     ,     12(ShowSCN)
    thx
    Edited by: Elson Wong on Dec 1, 2011 5:16 AM

    hi,
    you have inputed  more than the numbers of characters allowed from the field.
    here please check from below.
    Description: Item No.
    Type: string
    Field Length: 20
    Related Table: OITM
    This field is mandatory
    Description: BP Code
    Type: string
    Field Length: 15
    Related Table: OCRD
    This field is mandatory
    Description: BP Catalog Number
    Type: string
    Field Length: 20
    Description: Display BP Catalog Number
    Type: enum
    Valid Values: tNO,tYES
    to find more explaination go to SDK documentation located at your local directory C:\Program Files\SAP\SAP Business One SDK\Help
    regards,
    Fidel

  • Error while importing Journal Entries by using Data Transfer Workbench (DTW

    Dear Experts,
    when i am trying to import journal entries (expese entry, met my cash) i got a error message for without entering the tax group.
    error message " you cannt post abase amount wihtout taxgroup JDTI BaseSum [line:1] [application defined or object error  65171]
    but in example (proving by SAP ) all these are mentioney as date ( tax group)
    please give me a solution for this.

    Hi Jijo,
    Check the link
    JE Tax Group
    Regards
    Jambulingam.P

Maybe you are looking for

  • System error: Default TXJCD is not filled in the table T001

    Hi friends, Can anyone help me out in this scenario? We are facing a peculiar problem. We are in a upgrade project from 4.5b to ECC 6.0.Client is not maintaining any tax codes i.e they are maintaining it outside SAP.The problem is when ever the billi

  • Getting text/html message in proper format

    i want to send a message in html format by setting the message content as: msg.setContent(messageText, "text/html");where String messageText="hello"; messageText="<html><body><font color=red>"+messageText+"</font></body></html>"; if i do this i get i

  • Problems printing double-sided PDFs

    Hi, When I print any PDF document on any printer as double-sided, the second side always prints upside-down. I am printing from Adobe Acrobat 7.1.0 professional for Windows XP. This is annoying and I need to fix this problem. Suggestions would be gre

  • Check Duplicate Accounts/Contacts

    Hi Forum, We have EP as the user interface and will be creating Accounts and Contacts through EP. 1.How can I check the duplicate Accounts/Contacts being created.Is there any standard FM or BAdi available. 2.And also how can I delete the duplicate en

  • EWA: error message in CRM check for SAP Solution Manager system

    Hello! In EWA report for SAP Solution Manager system I have seen error message: Many CSA* inbound queues in error status were detected in your system. As a result of this BDocs have not been delivered. And then table Queue Name