Load flat files from S3 into SQL Server 2008 R2

Hi, We have a few customers dropping files in Amazon S3. Could you please let me know how to load this data into SQL Server 2008 R2 database using SSIS? We are 2008 R2 BIDS environment.
Thanks in advance..............
Ione

Hi ione721,
You can install the PostgreSQL ODBC driver so that you can use the .Net Providers\Odbc Data Provider for ADO.NET Source component to connect to the Amazon cloud storage. After that, you can use a OLE DB Destination to load the data to SQL Server database.
Reference:
http://docs.aws.amazon.com/redshift/latest/mgmt/configure-odbc-connection.html 
Regards,
Mike Yin
TechNet Community Support

Similar Messages

  • Load Flat File from App Server

    HI, all.
    I want load flat file from appliation server. I created CSV file and loaded it on app. server with FM ARCHIVEFILE_CLIENT_TO_SERVER. After I created datasource and tried load data in the infocube. In this procedure I encountered with two problem
    1. When I look file in AL11, I doesn't see cyrillic symbols, instead this symbols I see #.
    2. When I try load data with data source, I get exception RS_EXCEPTION 000 "File don't open"
    Anybody can help me resolve this problem?
    wbr, Fanil.

    Hi, kodanda pani KV.
    2. File is was closed.
    1. Can me you clearly explain what you meen?
    wbr, Fanil

  • Pulling data from oracle into sql server 2005

    hi,
    these days i am working on sql server 2005 on windows server 2008 64 bit.
    and oracle 10g on 32 bit unix.
    my problem is that when i am pulling data from oracle into sql server it shows me about *500-700 entries less*.
    why this is happening? is it because 32 bit to 64bit? or is it because of different os?

    Akki,
    are you using snapshot or replication from MSSQL? I am doing the same thing, hope to share your experience.
    I am using import/export from MGT studio and pull some data from Oracle database, I am working on how to update the changes on these tables pulled from Oracle.
    Thanks,
    -hank

  • Sql is not working after changing from MsAccess into sql server

    Following Sql  is not working after changing from MsAccess into sql server. 
    sum(trn.sales) as sales,
    sum(trn.cost) as cost,
    sales - cost as profit // Here is not working . can we not use sales a column. Please advise
    from trn
    Kind Regards
    pol
    polachan

    It will not work if use two different column from the table or column  from two  different table
    Example
    sum(trn.sales * trn.rate) as salesAmount,
    sum(trn.cost) as cost,
    sum(trn.salesAmount)-sum(trn.cost) as profit ----- Here is not working . can we not use sales a column. Please advise
    from trn
    Regards
    polachan

  • Best way to migrate SharePoint 2003 data into SQL Server 2008

    Hi Experts,
        I am planning to migrate data from SharePoint 2003 into SQL Server 2008. After the migration SharePoint site will be deleted in couple of months and then that data will be feed into .Net Front end application
    1) What is the best and easy way to do it?
    2) Is there any way to automate the migration process? i.e. If a new record gets entered into SharePoint it should be populated into SQL Server 2008.
    3) Any other suggestions
    Thanks,
    John

    Dear John,
                    If it's just a few lists, and you just want to import them "as-is" then it should be possible to do so ... and survive to tell the about it ;-)
                   Generally speaking, You will need to write a small process (program or script) to read/parse each list and check if the item(s) are in the target table (I assuming that there is a distinct table as target
    for each list, and that each list has 'something" you can use to distinct each row), if it's not there, the just add them according to your needs.  
                   Then just rerun the process periodically and it would keep your databases up to date (you could even set ti up to update those records that have changes, but that would delay your process significantly)
                    What i just described is doable, and not TOO complicated, it could be done i a lot different ways, and with different alternatives of programming/scripting languages. for sure you can do it in any flavor
    of .net language, and even powershell.
                    As I mentioned, this is speaking in general, the actual implementation would depend on your specific needs and the kind of data that you have/need to keep.
    Best Regards / Saludos, Marianok
    Disclaimer: This post, and all included code and information is provided "AS IS" with no warranties or guarantees and confers no rights. Try it at your own risk, I take no responsibilities.
    Aclaración: Esta publicación, y todo en código e información en la misma, es provista "AS IS" / "Como Está" sin garantía alguna y no le confiere ningún derecho. Pruebelo su propio riesgo. No asumo responsabilidad alguna.

  • Changing CMS and Audit Repository databases from Oracle to SQl server 2008

    Hi guys,
      We have a Business Objects Dev environment which was installed with Oracle 10g database for CMS and Audit Repository.
    Our database team now decided to change the CMS and Audit databases of Dev BOE from Oracle to  SQL server 2008.
    What is the ideal way to achieve this? I'm concerned because the old DB is Oracle and the new one would be SQL server.
    Earlier, I have changed CMS database from one to another by stopping SIA , taking the backup of old DB into new and changing it in the Update Databse option. But in that case both old and new CMS databses were on SQL server 2005.
    Thanks,
    Ganga

    Denise,
      Thanks for the solution.
    We have done Windows AD and SAP integration on the Dev BOE. Will there be any issue with those after the DB change. I am guessing there won't be, but just want to confirm. Please reply.
      Also, we need to stop the old SIA and start using the new SIA after the step two is done right?

  • FM to tansfer data in flat file from presentation to application server

    Hi Experts,
    Please tell the FM to tansfer data in flat file from presentation server to application server or vice versa in ECC 6.0.
    Thanks.

    Hi,
    This is how you can achieve it:
    1. You read the flat file from presentation layer and store the file content in internal table gt_inrec
      CALL FUNCTION 'GUI_UPLOAD'
        EXPORTING
          filename                = gw_filename
          filetype                = 'ASC'
        IMPORTING
          filelength              = gw_length
          header                  = gw_header
        TABLES
          data_tab                = gt_inrec
        EXCEPTIONS
          file_open_error         = 1
          file_read_error         = 2
          no_batch                = 3
          gui_refuse_filetransfer = 4
          invalid_type            = 5
          no_authority            = 6
          unknown_error           = 7
          bad_data_format         = 8
          header_not_allowed      = 9
          separator_not_allowed   = 10
          header_too_long         = 11
          unknown_dp_error        = 12
          access_denied           = 13
          dp_out_of_memory        = 14
          disk_full               = 15
          dp_timeout              = 16
          OTHERS                  = 17.
    2. Create a new file at the application server:
      OPEN DATASET p_ofile FOR OUTPUT IN
      TEXT MODE ENCODING DEFAULT.
    3. Transfer the content from the internal table into the file at the application server:
        LOOP AT gt_inrec.
          TRANSFER gt_inrec-record TO p_ofile.
        ENDLOOP.
    Hope it helps,
    Lim....

  • Import data from postgreSQL into SQL server 2005

    I am trying to import one table from postgreSQL to SQL Server 2005 using sql server import and export wizard. When i test the connection after providing data source, location, username, password in the Data Link Properties section I get the message "Test Connection Succeeded". As soon as i press next to go onto next step i get the following error.
    TITLE: SQL Server Import and Export Wizard
    Cannot get string literals from the database connection "Provider=PostgreSQL.1;User ID=sa;Data Source=localhost;Location=TestMasterMap;Extended Properties=".
    ADDITIONAL INFORMATION:
    Object reference not set to an instance of an object. (DTSWizard)
    BUTTONS:
    OK
    I have tried all sorts of different combinations for these properties but it always fails on this step. Can anybody help me with this?
     

    The settings above worked for a small table with 3 rows. Now when I try to import the bigger table which I wanted to import in the first instance I get following out of memory error. Anybody knows how to work around this. I have checked my task manager and more than half of my memory was still not used when I get this error.
    TITLE: SQL Server Import and Export Wizard
    Column information for the source and destination data could not be retrieved.
    "Query" -> [temporary].[dbo].[exporttable]:
                      - ERROR [HY000] Out of memory while reading tuples.;
    No query has been executed with that handle
    ADDITIONAL INFORMATION:
    ERROR [HY000] Out of memory while reading tuples.;
    No query has been executed with that handle (PSQLODBC.DLL)
    BUTTONS:
    OK

  • Inserting data from Oracle to SQL Server 2008

    Hi All,
    I am using oracle 9.2.0.7 and SQL server 2008 in windows server 2003 operating system.
    My requirment is like below.
    1) I would liek to insert data from the Oracle database to SQL Server.
    For the above requirement we have created the ODBC, then configure the listener file, tns file, and created the db link. This part is working fine as I am able to select the data from the SQL Server.
    But when I am inserting the record from the oracle database to the SQL Server I am getting the error, (ORA-00904) Here oracle can not identified the column name.
    My insert statement is like below.
    insert into test@SQLTEST (name, fullname)
    values ('Oracle', 'Oracle server data');
    Test is the SQL server table name and sqltest is the db link name.
    If I am select the data
    select * from test@SQLTEST from Oralce I am getting the data properly.
    Thanks,
    SUN
    Edited by: User SUN@ on Jun 9, 2010 5:49 PM

    Hi,
    I modify the column name as "f_name" and "l_name";
    Still I am getting the same error;
    Thanks,
    SUN

  • Windows 8 and IE 10 crashed after printing from Report Manager SQL server 2008 / 2008 R2

    We have a problem with Windows 8 in combination with IE 10 and printing reports.
    When we print a report from the Report Manager 'http://<servername>/reports' the browser crashed after a print.
    Sometimes before printing and somthimes after printing or when you close the browser.
    Al other operating systems like XP, Vista, Windows 7 with different IE versions have no problem.
    I tried the report manager from SQL Server 2008 and SQL Server 2008 R2.
    The same error occured when printing from our Internet application and the reportviewer.
    (ASP application written in Visual Studio 2010 and reportviewer version 10.)
    The event log shows two different messages.
    Faulting application name: IEXPLORE.EXE, version: 10.0.9200.16453, time stamp: 0x509b0dfb
    Faulting module name: ntdll.dll, version: 6.2.9200.16420, time stamp: 0x505aaa82
    Exception code: 0xc0000005
    Fault offset: 0x00061252
    Faulting process id: 0x780
    Faulting application start time: 0x01ce03a294f7d1d5
    Faulting application path: C:\Program Files (x86)\Internet Explorer\IEXPLORE.EXE
    Faulting module path: C:\Windows\SYSTEM32\ntdll.dll
    Report Id: d4a72486-6f96-11e2-be6e-10604b6a74ed
    Faulting package full name:
    Faulting package-relative application ID:
    Faulting application name: IEXPLORE.EXE, version: 10.0.9200.16384, time stamp: 0x50107ee0
    Faulting module name: rsclientprint.dll, version: 2009.100.1600.1, time stamp: 0x4bb67a74
    Exception code: 0xc0000005
    Fault offset: 0x00017e7a
    Faulting process id: 0x9c8
    Faulting application start time: 0x01ce02f35c70ab85
    Faulting application path: C:\Program Files (x86)\Internet Explorer\IEXPLORE.EXE
    Faulting module path: C:\Windows\Downloaded Program Files\rsclientprint.dll
    Report Id: a13fccc6-6ee6-11e2-be67-10604b6a74ed
    Faulting package full name:
    Faulting package-relative application ID:
    Is there a fix for this problem?

    Dear Mike Yin,
    Thank you for your response. Your answer was the
    reason for finding the real problem.
    In december 2010 a SQL Server 2008 fix was the cause. I don't remember exactly the problem, but we changed the RSCLIENTPrint-x86.cab file. But instead to use the version of SQL Server 2008 we used the version of SQL Server 2008
    R2 (10.50.1600.1). This worked until
    Windows 8 (Internet Explorer crashed when printing).
    We fixed this problem by using the RSClientPrint-x86.cab file from SQL server 2008 (10.0.5500.0).
    But we now get the known problem that the
    activeX always must be installed again. 
    The reason for this is that the version of
    the SQL Server (10.0.5512.0) 
    and the rsclientprint.dll (10.0.5500.0) is different. SQL Server is newer (caused
    by a security patch (KB2716436)).
    Do you know when this problem will be resolved
    by Microsoft?
    Work arrounds
    I've also tried to install the RSClientprint.dll
    every time automatically (without user interaction).
    But this will be delayed the printing for more
    than 4 seconds. This
    is very annoying.
    Another workaround is to generate a PDF and print the PDF. But this is also
    a lot slower.
    Uninstall the security patch. but I don't know the security risk.

  • RH server 8 - upscaling from Access to SQL Server 2008?

    Hi gang-
    We are currently running RoboHelp Server 8 on the default Access database and Tomcat. We would like to increase the number of help projects that are tracked by the RH Server, and have concerns that Access will handle the increased load, so we are considering upsizing to SQL Server 2008.
    Our IT people think this should be fairly straightforward, but want to know if Adobe provides any tool or has any recommendations when upsizing from Access to SQL Server.They are concerned about retaining things like primary and secondary keys, as well as any indexes that are currently in Access.
    If anyone has experience with such a migration, please share!
    Thanks,
    -=Ed.

    We are also currently on an Access DB and considering (have been for some time but that's a different story) upgrading to SQL Server. There is no migration tool from Access to SQL Server provided so you'd have to allow some additional effort if you want to retain the data. I am not an expert on DBs but I'm sure there are ways to migrate the data. I have found a few links when searching on Google. For example:
    http://support.microsoft.com/kb/237980
    Adobe does provide a cheat sheet at the link below which may be useful to you.
    http://blogs.adobe.com/techcomm/2009/05/advanced_database_setup_for_robohelp_server_8.html
      The RoboColum(n)
      @robocolumn
      Colum McAndrew

  • Converting MDX query into SQL Server 2008

    We have MDX query based OLAP CUbes.
    To reduce MDX based dependenies, we have to convert MDX based cube to sql server 2008 based queries.
    For this I need expert advise to convert below query to sql server 2008 based query :
    CREATE MEMBER CURRENTCUBE.Measures.[Ack Lost]
                        AS 'Sum(PeriodsToDate([Time].[Year], [Time].CurrentMember ), [Measures].[Lost])',
                        FORMAT_STRING = "#,#",
                        VISIBLE = 1;

    Hi Sachin,
    According to your description, you need to convert the MDX query to T-SQL query, right?
    Your MDX query is calculated measure that return the total value from the first sibling and ending with the given member. In T-SQL query we can use the query as Yogisha provided to achieve the same requirement. Now you need to a tool to convert all the MDX
    related SSAS cube queries to MS SQL Server 2008 based queries.
    Although MDX has some similarities with T-SQL these languages are in many ways different. Beginning to learn and comprehend SQL Server Analysis Services (SSAS) MDX queries can be difficult after one has spent years writing queries in T-SQL. Currently, there
    is no such a tool to convert a MDX query to T-SQL query since the structure difference between MDX and T-SQL. So you need to convert them manually, please refer to the links below to see the details.
    http://www.mssqltips.com/sqlservertip/2916/comparison-of-queries-written-in-tsql-and-sql-server-mdx/
    https://sqlmate.wordpress.com/2013/11/12/t-sql-vs-mdx-2/
    http://technet.microsoft.com/en-us/library/aa216779(v=sql.80).aspx
    Regards,
    Charlie Liao
    TechNet Community Support

  • Export SQL Express Database into SQL Server 2008 R2

    We have an application using SQL express and want to export it's database into our more centralised SQL Server 2008 R2
    Can this be done? What steps should I take?

    We have an application using SQL express and want to export it's database into our more centralised SQL Server 2008 R2
    Can this be done? What steps should I take?
    What is version of you SQL server express if it is 2008 and above you can use Import export wizard to move data.You can do by backup also but if your requirement is just to move data use Imp export wizard see below link
    http://blog.winhost.com/exporting-sql-server-data-with-import-and-export-wizard/
    Please mark this reply as the answer or vote as helpful, as appropriate, to make it useful for other readers

  • How to send PLAIN text email from sp_send_dbmail using SQL Server 2008 R2?

    I have configured Database Mail in SQL Server 2008 R2 (64) and it sends emails just fine. However the destination is recieving the body of thes message as Base 64 encoding.
    Snippet:
    EXEC msdb..sp_send_dbmail @profile_name='Outmail', @recipients = @recpts, @subject = @subj, @body_format = 'TEXT', @body=@body2;
    As you can see I set @body_format to TEXT, but it still sends Base 64. I need to send plain ASCII text. How can I change this?

    I am having this exact issue too.  I have a trigger that sends an email using a stored procedure.  The dbmail is sending the email using the Exchange 2010 server SMTP.  It does not login so the email is relayed as user = "Anonymous". 
    The SQL dbmail email header is showing the following:
    Content-Type: text/plain; charset="utf-8"
    Content-Transfer-Encoding: base64
    MIME-Version: 1.0
    X-MS-Exchange-Organization-AuthSource: MX01.domain.local
    X-MS-Exchange-Organization-AuthAs: Anonymous
    Here is the header if I send via Outlook profile using the legacy program I am trying to automate using SQL Server 2008R2:
    Content-Type: application/ms-tnef; name="winmail.dat"
    Content-Transfer-Encoding: binary
    MIME-Version: 1.0
    X-MS-Has-Attach:
    X-MS-Exchange-Organization-SCL: -1
    X-MS-TNEF-Correlator: <[email protected]>
    MIME-Version: 1.0
    X-MS-Exchange-Organization-AuthSource: MX01.domain.local
    X-MS-Exchange-Organization-AuthAs: Internal
    X-MS-Exchange-Organization-AuthMechanism: 03
    X-Originating-IP: [192.168.13.66]
    Any help would be greatly appreciated!

  • Loading flat files from a folder

    hi,
    i'm new in O.W.B., want to know if there is a way to import flat files into OWB directly from a folder. that is, automatically, without having to import one at a time.
    thanks.

    Hi Francesco
    So the UI lets you import one at a time or say this file is the same as that file (if same number of columns). You can also configure an external table or flat file mapping to add many data files to be read for the one external table or flat file mapping.
    If you want to import the metadata into OWB by pointing at a directory and importing all of the files there automatically then you would have to script this up. I have written scripts in the past that read metadata from files (such as for fixed length files for example the Oracle Sales Analyzer/OSA product has such files) and generate flat file definitions and external tables. The metadata files describe the fixed length fields, both the positional and datatype information. With CSVs if the files have a header row with a name for the column, you could script some of this or default the names, but then the datatypes would also have to be inferred by analyzing or from some metadata that can be added.
    Cheers
    David

Maybe you are looking for