Load flat files from S3 into SQL Server 2008 R2
Hi, We have a few customers dropping files in Amazon S3. Could you please let me know how to load this data into SQL Server 2008 R2 database using SSIS? We are 2008 R2 BIDS environment.
Thanks in advance..............
Ione
Hi ione721,
You can install the PostgreSQL ODBC driver so that you can use the .Net Providers\Odbc Data Provider for ADO.NET Source component to connect to the Amazon cloud storage. After that, you can use a OLE DB Destination to load the data to SQL Server database.
Reference:
http://docs.aws.amazon.com/redshift/latest/mgmt/configure-odbc-connection.html
Regards,
Mike Yin
TechNet Community Support
Similar Messages
-
Load Flat File from App Server
HI, all.
I want load flat file from appliation server. I created CSV file and loaded it on app. server with FM ARCHIVEFILE_CLIENT_TO_SERVER. After I created datasource and tried load data in the infocube. In this procedure I encountered with two problem
1. When I look file in AL11, I doesn't see cyrillic symbols, instead this symbols I see #.
2. When I try load data with data source, I get exception RS_EXCEPTION 000 "File don't open"
Anybody can help me resolve this problem?
wbr, Fanil.Hi, kodanda pani KV.
2. File is was closed.
1. Can me you clearly explain what you meen?
wbr, Fanil -
Pulling data from oracle into sql server 2005
hi,
these days i am working on sql server 2005 on windows server 2008 64 bit.
and oracle 10g on 32 bit unix.
my problem is that when i am pulling data from oracle into sql server it shows me about *500-700 entries less*.
why this is happening? is it because 32 bit to 64bit? or is it because of different os?Akki,
are you using snapshot or replication from MSSQL? I am doing the same thing, hope to share your experience.
I am using import/export from MGT studio and pull some data from Oracle database, I am working on how to update the changes on these tables pulled from Oracle.
Thanks,
-hank -
Sql is not working after changing from MsAccess into sql server
Following Sql is not working after changing from MsAccess into sql server.
sum(trn.sales) as sales,
sum(trn.cost) as cost,
sales - cost as profit // Here is not working . can we not use sales a column. Please advise
from trn
Kind Regards
pol
polachanIt will not work if use two different column from the table or column from two different table
Example
sum(trn.sales * trn.rate) as salesAmount,
sum(trn.cost) as cost,
sum(trn.salesAmount)-sum(trn.cost) as profit ----- Here is not working . can we not use sales a column. Please advise
from trn
Regards
polachan -
Best way to migrate SharePoint 2003 data into SQL Server 2008
Hi Experts,
I am planning to migrate data from SharePoint 2003 into SQL Server 2008. After the migration SharePoint site will be deleted in couple of months and then that data will be feed into .Net Front end application
1) What is the best and easy way to do it?
2) Is there any way to automate the migration process? i.e. If a new record gets entered into SharePoint it should be populated into SQL Server 2008.
3) Any other suggestions
Thanks,
JohnDear John,
If it's just a few lists, and you just want to import them "as-is" then it should be possible to do so ... and survive to tell the about it ;-)
Generally speaking, You will need to write a small process (program or script) to read/parse each list and check if the item(s) are in the target table (I assuming that there is a distinct table as target
for each list, and that each list has 'something" you can use to distinct each row), if it's not there, the just add them according to your needs.
Then just rerun the process periodically and it would keep your databases up to date (you could even set ti up to update those records that have changes, but that would delay your process significantly)
What i just described is doable, and not TOO complicated, it could be done i a lot different ways, and with different alternatives of programming/scripting languages. for sure you can do it in any flavor
of .net language, and even powershell.
As I mentioned, this is speaking in general, the actual implementation would depend on your specific needs and the kind of data that you have/need to keep.
Best Regards / Saludos, Marianok
Disclaimer: This post, and all included code and information is provided "AS IS" with no warranties or guarantees and confers no rights. Try it at your own risk, I take no responsibilities.
Aclaración: Esta publicación, y todo en código e información en la misma, es provista "AS IS" / "Como Está" sin garantía alguna y no le confiere ningún derecho. Pruebelo su propio riesgo. No asumo responsabilidad alguna. -
Changing CMS and Audit Repository databases from Oracle to SQl server 2008
Hi guys,
We have a Business Objects Dev environment which was installed with Oracle 10g database for CMS and Audit Repository.
Our database team now decided to change the CMS and Audit databases of Dev BOE from Oracle to SQL server 2008.
What is the ideal way to achieve this? I'm concerned because the old DB is Oracle and the new one would be SQL server.
Earlier, I have changed CMS database from one to another by stopping SIA , taking the backup of old DB into new and changing it in the Update Databse option. But in that case both old and new CMS databses were on SQL server 2005.
Thanks,
GangaDenise,
Thanks for the solution.
We have done Windows AD and SAP integration on the Dev BOE. Will there be any issue with those after the DB change. I am guessing there won't be, but just want to confirm. Please reply.
Also, we need to stop the old SIA and start using the new SIA after the step two is done right? -
FM to tansfer data in flat file from presentation to application server
Hi Experts,
Please tell the FM to tansfer data in flat file from presentation server to application server or vice versa in ECC 6.0.
Thanks.Hi,
This is how you can achieve it:
1. You read the flat file from presentation layer and store the file content in internal table gt_inrec
CALL FUNCTION 'GUI_UPLOAD'
EXPORTING
filename = gw_filename
filetype = 'ASC'
IMPORTING
filelength = gw_length
header = gw_header
TABLES
data_tab = gt_inrec
EXCEPTIONS
file_open_error = 1
file_read_error = 2
no_batch = 3
gui_refuse_filetransfer = 4
invalid_type = 5
no_authority = 6
unknown_error = 7
bad_data_format = 8
header_not_allowed = 9
separator_not_allowed = 10
header_too_long = 11
unknown_dp_error = 12
access_denied = 13
dp_out_of_memory = 14
disk_full = 15
dp_timeout = 16
OTHERS = 17.
2. Create a new file at the application server:
OPEN DATASET p_ofile FOR OUTPUT IN
TEXT MODE ENCODING DEFAULT.
3. Transfer the content from the internal table into the file at the application server:
LOOP AT gt_inrec.
TRANSFER gt_inrec-record TO p_ofile.
ENDLOOP.
Hope it helps,
Lim.... -
Import data from postgreSQL into SQL server 2005
I am trying to import one table from postgreSQL to SQL Server 2005 using sql server import and export wizard. When i test the connection after providing data source, location, username, password in the Data Link Properties section I get the message "Test Connection Succeeded". As soon as i press next to go onto next step i get the following error.
TITLE: SQL Server Import and Export Wizard
Cannot get string literals from the database connection "Provider=PostgreSQL.1;User ID=sa;Data Source=localhost;Location=TestMasterMap;Extended Properties=".
ADDITIONAL INFORMATION:
Object reference not set to an instance of an object. (DTSWizard)
BUTTONS:
OK
I have tried all sorts of different combinations for these properties but it always fails on this step. Can anybody help me with this?
The settings above worked for a small table with 3 rows. Now when I try to import the bigger table which I wanted to import in the first instance I get following out of memory error. Anybody knows how to work around this. I have checked my task manager and more than half of my memory was still not used when I get this error.
TITLE: SQL Server Import and Export Wizard
Column information for the source and destination data could not be retrieved.
"Query" -> [temporary].[dbo].[exporttable]:
- ERROR [HY000] Out of memory while reading tuples.;
No query has been executed with that handle
ADDITIONAL INFORMATION:
ERROR [HY000] Out of memory while reading tuples.;
No query has been executed with that handle (PSQLODBC.DLL)
BUTTONS:
OK -
Inserting data from Oracle to SQL Server 2008
Hi All,
I am using oracle 9.2.0.7 and SQL server 2008 in windows server 2003 operating system.
My requirment is like below.
1) I would liek to insert data from the Oracle database to SQL Server.
For the above requirement we have created the ODBC, then configure the listener file, tns file, and created the db link. This part is working fine as I am able to select the data from the SQL Server.
But when I am inserting the record from the oracle database to the SQL Server I am getting the error, (ORA-00904) Here oracle can not identified the column name.
My insert statement is like below.
insert into test@SQLTEST (name, fullname)
values ('Oracle', 'Oracle server data');
Test is the SQL server table name and sqltest is the db link name.
If I am select the data
select * from test@SQLTEST from Oralce I am getting the data properly.
Thanks,
SUN
Edited by: User SUN@ on Jun 9, 2010 5:49 PMHi,
I modify the column name as "f_name" and "l_name";
Still I am getting the same error;
Thanks,
SUN -
Windows 8 and IE 10 crashed after printing from Report Manager SQL server 2008 / 2008 R2
We have a problem with Windows 8 in combination with IE 10 and printing reports.
When we print a report from the Report Manager 'http://<servername>/reports' the browser crashed after a print.
Sometimes before printing and somthimes after printing or when you close the browser.
Al other operating systems like XP, Vista, Windows 7 with different IE versions have no problem.
I tried the report manager from SQL Server 2008 and SQL Server 2008 R2.
The same error occured when printing from our Internet application and the reportviewer.
(ASP application written in Visual Studio 2010 and reportviewer version 10.)
The event log shows two different messages.
Faulting application name: IEXPLORE.EXE, version: 10.0.9200.16453, time stamp: 0x509b0dfb
Faulting module name: ntdll.dll, version: 6.2.9200.16420, time stamp: 0x505aaa82
Exception code: 0xc0000005
Fault offset: 0x00061252
Faulting process id: 0x780
Faulting application start time: 0x01ce03a294f7d1d5
Faulting application path: C:\Program Files (x86)\Internet Explorer\IEXPLORE.EXE
Faulting module path: C:\Windows\SYSTEM32\ntdll.dll
Report Id: d4a72486-6f96-11e2-be6e-10604b6a74ed
Faulting package full name:
Faulting package-relative application ID:
Faulting application name: IEXPLORE.EXE, version: 10.0.9200.16384, time stamp: 0x50107ee0
Faulting module name: rsclientprint.dll, version: 2009.100.1600.1, time stamp: 0x4bb67a74
Exception code: 0xc0000005
Fault offset: 0x00017e7a
Faulting process id: 0x9c8
Faulting application start time: 0x01ce02f35c70ab85
Faulting application path: C:\Program Files (x86)\Internet Explorer\IEXPLORE.EXE
Faulting module path: C:\Windows\Downloaded Program Files\rsclientprint.dll
Report Id: a13fccc6-6ee6-11e2-be67-10604b6a74ed
Faulting package full name:
Faulting package-relative application ID:
Is there a fix for this problem?Dear Mike Yin,
Thank you for your response. Your answer was the
reason for finding the real problem.
In december 2010 a SQL Server 2008 fix was the cause. I don't remember exactly the problem, but we changed the RSCLIENTPrint-x86.cab file. But instead to use the version of SQL Server 2008 we used the version of SQL Server 2008
R2 (10.50.1600.1). This worked until
Windows 8 (Internet Explorer crashed when printing).
We fixed this problem by using the RSClientPrint-x86.cab file from SQL server 2008 (10.0.5500.0).
But we now get the known problem that the
activeX always must be installed again.
The reason for this is that the version of
the SQL Server (10.0.5512.0)
and the rsclientprint.dll (10.0.5500.0) is different. SQL Server is newer (caused
by a security patch (KB2716436)).
Do you know when this problem will be resolved
by Microsoft?
Work arrounds
I've also tried to install the RSClientprint.dll
every time automatically (without user interaction).
But this will be delayed the printing for more
than 4 seconds. This
is very annoying.
Another workaround is to generate a PDF and print the PDF. But this is also
a lot slower.
Uninstall the security patch. but I don't know the security risk. -
RH server 8 - upscaling from Access to SQL Server 2008?
Hi gang-
We are currently running RoboHelp Server 8 on the default Access database and Tomcat. We would like to increase the number of help projects that are tracked by the RH Server, and have concerns that Access will handle the increased load, so we are considering upsizing to SQL Server 2008.
Our IT people think this should be fairly straightforward, but want to know if Adobe provides any tool or has any recommendations when upsizing from Access to SQL Server.They are concerned about retaining things like primary and secondary keys, as well as any indexes that are currently in Access.
If anyone has experience with such a migration, please share!
Thanks,
-=Ed.We are also currently on an Access DB and considering (have been for some time but that's a different story) upgrading to SQL Server. There is no migration tool from Access to SQL Server provided so you'd have to allow some additional effort if you want to retain the data. I am not an expert on DBs but I'm sure there are ways to migrate the data. I have found a few links when searching on Google. For example:
http://support.microsoft.com/kb/237980
Adobe does provide a cheat sheet at the link below which may be useful to you.
http://blogs.adobe.com/techcomm/2009/05/advanced_database_setup_for_robohelp_server_8.html
The RoboColum(n)
@robocolumn
Colum McAndrew -
Converting MDX query into SQL Server 2008
We have MDX query based OLAP CUbes.
To reduce MDX based dependenies, we have to convert MDX based cube to sql server 2008 based queries.
For this I need expert advise to convert below query to sql server 2008 based query :
CREATE MEMBER CURRENTCUBE.Measures.[Ack Lost]
AS 'Sum(PeriodsToDate([Time].[Year], [Time].CurrentMember ), [Measures].[Lost])',
FORMAT_STRING = "#,#",
VISIBLE = 1;Hi Sachin,
According to your description, you need to convert the MDX query to T-SQL query, right?
Your MDX query is calculated measure that return the total value from the first sibling and ending with the given member. In T-SQL query we can use the query as Yogisha provided to achieve the same requirement. Now you need to a tool to convert all the MDX
related SSAS cube queries to MS SQL Server 2008 based queries.
Although MDX has some similarities with T-SQL these languages are in many ways different. Beginning to learn and comprehend SQL Server Analysis Services (SSAS) MDX queries can be difficult after one has spent years writing queries in T-SQL. Currently, there
is no such a tool to convert a MDX query to T-SQL query since the structure difference between MDX and T-SQL. So you need to convert them manually, please refer to the links below to see the details.
http://www.mssqltips.com/sqlservertip/2916/comparison-of-queries-written-in-tsql-and-sql-server-mdx/
https://sqlmate.wordpress.com/2013/11/12/t-sql-vs-mdx-2/
http://technet.microsoft.com/en-us/library/aa216779(v=sql.80).aspx
Regards,
Charlie Liao
TechNet Community Support -
Export SQL Express Database into SQL Server 2008 R2
We have an application using SQL express and want to export it's database into our more centralised SQL Server 2008 R2
Can this be done? What steps should I take?We have an application using SQL express and want to export it's database into our more centralised SQL Server 2008 R2
Can this be done? What steps should I take?
What is version of you SQL server express if it is 2008 and above you can use Import export wizard to move data.You can do by backup also but if your requirement is just to move data use Imp export wizard see below link
http://blog.winhost.com/exporting-sql-server-data-with-import-and-export-wizard/
Please mark this reply as the answer or vote as helpful, as appropriate, to make it useful for other readers -
How to send PLAIN text email from sp_send_dbmail using SQL Server 2008 R2?
I have configured Database Mail in SQL Server 2008 R2 (64) and it sends emails just fine. However the destination is recieving the body of thes message as Base 64 encoding.
Snippet:
EXEC msdb..sp_send_dbmail @profile_name='Outmail', @recipients = @recpts, @subject = @subj, @body_format = 'TEXT', @body=@body2;
As you can see I set @body_format to TEXT, but it still sends Base 64. I need to send plain ASCII text. How can I change this?I am having this exact issue too. I have a trigger that sends an email using a stored procedure. The dbmail is sending the email using the Exchange 2010 server SMTP. It does not login so the email is relayed as user = "Anonymous".
The SQL dbmail email header is showing the following:
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-Organization-AuthSource: MX01.domain.local
X-MS-Exchange-Organization-AuthAs: Anonymous
Here is the header if I send via Outlook profile using the legacy program I am trying to automate using SQL Server 2008R2:
Content-Type: application/ms-tnef; name="winmail.dat"
Content-Transfer-Encoding: binary
MIME-Version: 1.0
X-MS-Has-Attach:
X-MS-Exchange-Organization-SCL: -1
X-MS-TNEF-Correlator: <[email protected]>
MIME-Version: 1.0
X-MS-Exchange-Organization-AuthSource: MX01.domain.local
X-MS-Exchange-Organization-AuthAs: Internal
X-MS-Exchange-Organization-AuthMechanism: 03
X-Originating-IP: [192.168.13.66]
Any help would be greatly appreciated! -
Loading flat files from a folder
hi,
i'm new in O.W.B., want to know if there is a way to import flat files into OWB directly from a folder. that is, automatically, without having to import one at a time.
thanks.Hi Francesco
So the UI lets you import one at a time or say this file is the same as that file (if same number of columns). You can also configure an external table or flat file mapping to add many data files to be read for the one external table or flat file mapping.
If you want to import the metadata into OWB by pointing at a directory and importing all of the files there automatically then you would have to script this up. I have written scripts in the past that read metadata from files (such as for fixed length files for example the Oracle Sales Analyzer/OSA product has such files) and generate flat file definitions and external tables. The metadata files describe the fixed length fields, both the positional and datatype information. With CSVs if the files have a header row with a name for the column, you could script some of this or default the names, but then the datatypes would also have to be inferred by analyzing or from some metadata that can be added.
Cheers
David
Maybe you are looking for
-
Fire fox use to remember the pages I had up when I closed it. Now it just opens with my home page/
-
Searching in a Database plz help!
Hi i'm stuck... doe anyone know how to search trough a database (of 10.000 records) iv'e made a search code butt it doesn;t work with a large database that's mine first probleem and mine second probleem is how to convert a String to a float and Strin
-
did the most recent update and now my TB Display turns off randomly on both my air and mini. I running TB Firmware Version: 23.6
-
Problem with call connect license
Hi to all, recently we purchased some call connect cisco software licenses. We first install those licenses without any problems. Weeks ago the customer bought some new nokia phone and we had to free old licenses to enter them in the new phones. We e
-
10.4.8 Nothing Downloads Properly
Since updating to 10.4.8 (if updating is the correct term) have had nothing but problems with: The Update-download-install and use of 10.4.8 Still cannot download anything..all downloads are incomplete... This was never a problem with all previous op