SQL table or Txt file as target

Hi,
I have been asked my my IT department if FDM can have a Sql table or a txt file as a target instead of using the normal EPM products like esbase/hfm.
They like the interface as a user friendly interface for collecting data and validating data from numerus sources.
We are trying to collect invoicing data from our subsiduaries, to produce one electronic invoice to our customer.
Does anyone have any experiences with this - and is this something they could recommend.
Is htis perhaps more a job for ODI?
Kind regards
Per

Hi Per
There are other adapters for FDM so you do not have to use exclusively HFM / Essbase as targets. It sounds as though you may be interested in the 'Pull' adapter, please see the Oracle readme doc for one of the latest versions of that:
http://docs.oracle.com/cd/E17236_01/epm.1112/fdm_adapter_readmes/pull_g4_e_adapter_readme.pdf
Essentially it imports to FDM as normal (stored in its underlying relational schema be it SQL or Oracle) and then outputs to text file I believe as standard but I'm sure that you could amend that if required to be a relational target.
One thing to note is that some of the features of the HFM adapter in particular regarding FDM checking HFM for valid target intersections / members won't be there but you can I believe load a table of valid values into FDM and use that as a replacement to that feature.
Worth a look at least to compare against ODI. ODI will be able to perform similar tasks but as you suggest may not be as end user friendly (in my opinion / experience).
Regards
Stuart

Similar Messages

SQL table to a file

Ok, just need some idea's really. Trying to figure out a good way to get all the information from a SQL table into a file and have it organised properly, so that i can read it all back into arrays or back into another table.
Right now i have no clue as to how to go about it. FileInputStream seems to be my only thought, but i wouldn't know how to distinguish between each row or even each column so i can read it back to an array.
Any ideas would be helpful. Not looking for code or anything, although wouldn't mind.

CSV format? Sorry, totally ignorant of many
things!Google will help.
but i get your idea of saving each row to a file and
seperating each column with a comma. Then i'd
suppose i'd have to read that file into 1 string and
split it twice, so i get each column into its own
array. Or read the file line by line and split each line. If you have a lot of data you can't read the entire file into memory.
Can i save each row to the same file?Sure.
Like keeping
the file open and looping through the table
(rs.next()), and then saving each row to the file on
each iteration? I know i should look at the API, but
that just confuses me more.Then work through Sun's tutorials. They're very good.

Export Excel Table in .txt File with space delimited text in UNICODE Format

Hi all
I've a big unsolved problem: I would like to convert an Excel table with some laboratory data in it (descriptions as text, numbers, variables with some GREEK LETTERS, ...). The output should be a formatted text with a clear structure. A very good solution is
given by the converter in Excel "Save As" .prn File. All works fine, the formattation is perfect (it does not matter if some parts are cutted because are too long), but unfortunately the greek letters are converted into "?"!!!
I've tried to convert my .xlsx File in .txt File with formatting Unicode and the greek letters are still there! But in this case the format is not good, the structure of a table is gone!
Do you know how to save an Excel file in .prn but with Unicode formatting instead of ANSI or a .txt with space delimited text?
Thanks a lot to everyone that can help me!
M.L.C.

This solution works in Excel/Access 2013.
Link the Excel table into Access.
In Access, right-click the linked table in the Navigation Pane, point your mouse cursor to "Export", and then choose "Text File" in the sub-menu.
Name the file, and then under "Specify export options", check "Export data with formatting and layout". Click "OK".
Choose either Unicode or Unicode (UTF-8) encoding. Click "OK".
Click "Close" to complete the export operation.

Importing mapping tables via txt-file

Hi
Is it possible to import mapping tables for some dimensions using txt- or csv-file instead of excel-template?

Yes.
There is a format called "Ledger Link" which is dirt simple. It is a CSV file that has Source, Target, and Description. If you have a sign flip, you put a - in front of the Target. If instead of explicit map, it is a like, Source is the rule.
For example......
110011,3rdPartySales,Third Party Sales
110021,-ICSales,Intercompany Sales
11003?,ServiceRevenue,Service Revenue for Accounts starting with 11003 with a length of 6 characters

Can we create internal table from txt file seperated by space?

Hi all,
I have text file abc.txt :
BP1 SAP1
BP123 SAP2
Now I can read this file GUI_UPLOAD FM
But I want to return this as table with two columns and two rows.
First row with two columns: BP1 SAP1
Scond row with two column: BP2 SAP2
I tried using
TYPES:
BEGIN OF i_po_data,
BP(3) TYPE c, " lmax length of the line of the text file
BP_name(10) TYPE c,
END OF i_po_data.
but in this case
First 3 characters will be filled in first column.
But in the second row BP123 , BP1 will be in first column but
'23' will not fit in first column.
How to insert the data in the first column just by space?
so that BP123 can also fit in the second column.
Thanks,
SUSHANT

hi,
if you have declared a variable of length 3 ,then how can you store data in that varaible which is more then 3 in length?
change your varaible length to get required result.

Create SQL tables from dbf files

I have hundreds of dbf files that I need to import into SQL Server. I have created a foreach loop container and have a data task within the loop that will import the data. However, it will only work if the tables are already in SQL Server.
These tables may differ depending on versions so I cannot use the Wizard. I know I can do the CREATE TABLE using variables, but how can I get the schema from the dbf file in order to dynamically fill in the columns for the CREATE TABLE statement?

Thanks Arthur. Does anyone have an example? Considering the wizard can extract the column names, there has to be a way to set this up. I am new to SSIS and have not been able to figure out a way to grab at least the column names
via a script.
The wizard may extract the names. Then dump somewhere. Then create a script say in Excel off the column names, but you also need the lengths, datatypes. What is this dbf file? Is it dBase database? Can you open a file in a text editor?
We know nothing at this point still.
Arthur My Blog

How to skip text files in sql table ?

Hi,
I am using 10g developer suite. How to skip the record in to sql table from txt file ? Table has primary key concept.
At present I am skipping the record via sql loader. Is there any way in the forms like plsql coding ?
Warm regards
vasanth.

So I'm guessing you are loading a text file into a database table using SQL*Loader and using the skip funcionality to skip records you don't want loaded. Now you want to do something similar in PL/SQL?
You could take a look at External Tables which will allow you to specify the text file as an external table and skip rows just the same as SQL*Loader, but you can query directly from it, or you could go the long winded way about it and use the UTL_FILE package to open the file, read lines of data and process those lines yourself choosing whether to skip lines and which ones you want to insert into a table etc.

Insert Data into Table from TXT or CSV file !!!!!

Dear All,
Recently I have started working on APEX. In Oracle Forms, we used to use TEXT_IO for inserting records into tables from txt files. Now I want to do the same thing in apex 3.2. How can I insert data into tables from txt of csv files.
Waiting of your valuable suggestions.
With kind regards,
Yousuf.

Yousuf
wwv_flow_files is used by APEX to hold uploaded files.
If you incorporate a file browse item on you page, browse for the selected file, then submit the page (having the PL/SQL process described as an on suibmit process) then what I detailed should work.
If you don't need users to have access to this then just go to Home>Utilities>Data Load/Unload in APEX and there is a handy load utility there that does it all for you.
Cheers
Ben

Open a txt file in a real time PXI target

I want to open and read a txt file when targeting to a PXI, running a real time OS. The file is saved in a specific directory of the real time machine. When I run the typical Labview (version 7.1) examples there is alwasys an error message.

Hi Matt,
I hope you're doing well. To be able to open files on the host from the RT target or vice-versa, you most likely will need to FTP the files back and forth between the two. You need to have the files local on either machine to be able to edit or view them, and FTP is the simplest way to do so. You can connect to your RT target via any standard FTP utility as discussed in this KnowledgeBase article. I hope this is helpful. Let us know if you have any additional questions though.
Thaison V
Applications Engineer
National Instruments

Moving file from Target to Archive Directory

Hi All,
My Scenario is that we have a .txt file in Target directory in SAP PI (AL11) and when an arching Script is run this file is moved from Target folder to Archive Folder and also uploaded in R3.
Now the requirement is that the file is transffered from Target to Archive folder without being processed.Now the user want the file back in Taget folder from Archive Folder also user also wants to know who has run the Script.
Please let me know how to put file back from Archive to target folder and check the log as who Run the Script.
Regards,
Nidhi

Hi Nidhi,
I think i am not getting your question
>>when an arching Script is run this file is moved from Target folder to Archive Folder and also uploaded in R3.
Now how the script is run? using OS commands of File adapter or by some other means
>>Now the user want the file back in Taget folder from Archive Folder also user also wants to know who has run the Script.
For getting it back in Target folder, you can manually copy it. Also to see who has done this you need to check how the scripts run. If it runs as a standalone one then you need to see whether in the system you have some log files of the run. If file adapter runs this scripts then check the Communication channel monitoring log (BTW it if was File communication channel which invoked this Scripts then the message would have sent to PI. Need to recheck that too)
Regards
Suraj

Exporting list of tables to text files?

Anyone have solution for exporting list of SQL tables to text files?
My goal is to have a flexible/dynamic way to export sql tables to text files that is executed via a sql job. I plan on having a configuration table that has sqltablename, fieldstoexclude (maybe fieldstoinclude - not decided), path, filename, includeheader,
delimiter. So the SSIS package will query the configuration table and that will be the loop. One text file for each configuraton.tablename row.
Does anyone have an already built solution that they can share? I have seen some with vb script and am not opposed, but would like to have a strictly SSIS package that uses SQL queries for the solution.

Try using this as your query (Remember to set the database you want to use first:
DECLARE @tableBuilder TABLE (dSQL VARCHAR(MAX))
DECLARE @tableString VARCHAR(100), @newTableString VARCHAR(100), @columnString VARCHAR(MAX), @dSQL VARCHAR(MAX) = ''
DECLARE tableBuilder CURSOR FOR
SELECT
'CREATE TABLE '+d.name+'.'+t.name ,
c.name + ' ' +
CASE
WHEN st.NAME IN ('float','image','text','uniqueidentifier','date','time','datetime2','datetimeoffset','tinyint','smallint','int','smalldatetime','real','money','datetime','smallmoney','bigint','bit','hierarchyid','timestamp','xml','geometry','geography','sql_variant','sysname') THEN st.name
WHEN st.name IN ('decimal','numeric') THEN st.name + '(' + CONVERT(VARCHAR,c.precision) + ',' + CONVERT(VARCHAR,c.scale) + ')'
WHEN st.name IN ('nvarchar','nchar','char','varbinary','varchar','binary','ntext') THEN st.name + '(' + CONVERT(VARCHAR,c.max_length) +')'
END + ','+ char(13)+CHAR(10)
FROM sys.tables t
LEFT OUTER JOIN sys.extended_properties ep
ON t.object_id = ep.major_ID
AND ep.name = 'microsoft_database_tools_support'
INNER JOIN sys.columns c
ON t.object_id = c.object_id
INNER JOIN sys.systypes st
ON c.system_type_id = st.xtype
INNER JOIN sys.databases d
ON DB_ID() = d.database_id
WHERE ep.name IS NULL AND is_ms_shipped = 0
ORDER BY t.name, c.column_id
OPEN tableBuilder
FETCH tableBuilder INTO @tableString, @columnString
WHILE @@FETCH_STATUS <> -1
BEGIN
IF @tableString <> @newTableString
BEGIN
SET @dSQL = @newTableString + char(13)+CHAR(10) + ' (' + char(13)+CHAR(10) +LEFT(@dSQL,LEN(@dSQL)-3) + char(13)+CHAR(10) + ' )'
INSERT INTO @tableBuilder ( dSQL ) VALUES (@dSQL)
SET @dSQL = ''
END
SET @dSQL = @dSQL + ' ' + @columnString
SET @newTableString = @tableString
FETCH tableBuilder INTO @tableString, @columnString
END
CLOSE tableBuilder
DEALLOCATE tableBuilder
SELECT * FROM @tableBuilder
Export the results of that as you like.

Sql query in txt

I read files from a file,not using jdbc or something else.Can I make a sqlquery directly on the read variable?Is there a possibility for making sql query in *.txt files.

Andreas Weiden wrote:
There is a commercial tool called plpdf, but i can't tell if its good..
Also possible would be to create an XML-FO with sql or pl/sql.
And then use Apache-FOP to convert the XML-FO into a pdf, rtf or whatever you want.
No extra costs but the effort to learn a bit about the fo elements/syntax.
I think the newer Apex-Versions can doing something like this also. Maybe additionally ask in the Apex Forums.

Method to dump all tables to flat files? (spool is slow)

Hey all,
I have been using spool with a bunch of set commands and it works great, but performance is a bit slow. Especially for our partitioned tables. (4.2 Mill records) Is there a better way to dump flat files?
I want to use sqlldr to import (faster than IMP) but no good if creating the flat files is 10X slower than EXP utility.
Any ideas?
Thanks,
Chris G

Hi Chris,
Maybe spooling itself is not a key issue which slow down your dumping. In my daily job, I need to dump a big bunch of data (even over 10M records in one table) to .txt files and .csv files and they are all done via spooling.
If you find the query itself is slow, caused by partition or join, you can try to create materialized tables to get the query results and then dump the data from these tables. This is an approach when I was working on a big data warehouse project.
Good luck,

SQL Loader problem while loading records from txt file to database table.

I am getting following error while loading records from flat txt file into database table with the help of 'sqlldr' command. I have executed catldr.sql from RDBMS folder but it is still showing same error. I am setting DIRECT = TRUE while issuing sqlldr command. If I try with DIRECT = FALSE then it works fine. Database is Oracle 8i.
SQL*Loader-951: Error calling once/load initialization
ORA-24329: invalid character set identifier
F1 Please.

Hello,
Direct path load, can only be used with SQL*Loader and Database have the same version.
Care to tell the database version and sql*loader version you are using.
-Sri

How to convert from SQL Server table to Flat file (txt file)

I need To ask question how convert from SQL Server table to Flat file txt file

Hi
1. Import/Export wizened
2. Bcp utility
3. SSIS
1.Import/Export Wizard
First and very manual technique is the import wizard. This is great for ad-hoc and just to slam it in tasks.
In SSMS right click the database you want to import into. Scroll to Tasks and select Import Data…
For the data source we want out zips.txt file. Browse for it and select it. You should notice the wizard tries to fill in the blanks for you. One key thing here with this file I picked is there are “ “ qualifiers. So we need to make
sure we add “ into the text qualifier field. The wizard will not do this for you.
Go through the remaining pages to view everything. No further changes should be needed though
Hit next after checking the pages out and select your destination. This in our case will be DBA.dbo.zips.
Following the destination step, go into the edit mappings section to ensure we look good on the types and counts.
Hit next and then finish. Once completed you will see the count of rows transferred and the success or failure rate
Import wizard completed and you have the data!
bcp utility
Method two is bcp with a format file http://msdn.microsoft.com/en-us/library/ms162802.aspx
This is probably going to win for speed on most occasions but is limited to the formatting of the file being imported. For this file it actually works well with a small format file to show the contents and mappings to SQL Server.
To create a format file all we really need is the type and the count of columns for the most basic files. In our case the qualifier makes it a bit difficult but there is a trick to ignoring them. The trick is to basically throw a field into the
format file that will reference it but basically ignore it in the import process.
Given that our format file in this case would appear like this
9.0
9
1 SQLCHAR 0 0 """ 0 dummy1 ""
2 SQLCHAR 0 50 "","" 1 Field1 ""
3 SQLCHAR 0 50 "","" 2 Field2 ""
4 SQLCHAR 0 50 "","" 3 Field3 ""
5 SQLCHAR 0 50 ""," 4 Field4 ""
6 SQLCHAR 0 50 "," 5 Field5 ""
7 SQLCHAR 0 50 "," 6 Field6 ""
8 SQLCHAR 0 50 "," 7 Field7 ""
9 SQLCHAR 0 50 "n" 8 Field8 ""
The bcp call would be as follows
C:Program FilesMicrosoft SQL Server90ToolsBinn>bcp DBA..zips in “C:zips.txt” -f “c:zip_format_file.txt” -S LKFW0133 -T
Given a successful run you should see this in command prompt after executing the statement
Starting copy...
1000 rows sent to SQL Server. Total sent: 1000
1000 rows sent to SQL Server. Total sent: 2000
1000 rows sent to SQL Server. Total sent: 3000
1000 rows sent to SQL Server. Total sent: 4000
1000 rows sent to SQL Server. Total sent: 5000
1000 rows sent to SQL Server. Total sent: 6000
1000 rows sent to SQL Server. Total sent: 7000
1000 rows sent to SQL Server. Total sent: 8000
1000 rows sent to SQL Server. Total sent: 9000
1000 rows sent to SQL Server. Total sent: 10000
1000 rows sent to SQL Server. Total sent: 11000
1000 rows sent to SQL Server. Total sent: 12000
1000 rows sent to SQL Server. Total sent: 13000
1000 rows sent to SQL Server. Total sent: 14000
1000 rows sent to SQL Server. Total sent: 15000
1000 rows sent to SQL Server. Total sent: 16000
1000 rows sent to SQL Server. Total sent: 17000
1000 rows sent to SQL Server. Total sent: 18000
1000 rows sent to SQL Server. Total sent: 19000
1000 rows sent to SQL Server. Total sent: 20000
1000 rows sent to SQL Server. Total sent: 21000
1000 rows sent to SQL Server. Total sent: 22000
1000 rows sent to SQL Server. Total sent: 23000
1000 rows sent to SQL Server. Total sent: 24000
1000 rows sent to SQL Server. Total sent: 25000
1000 rows sent to SQL Server. Total sent: 26000
1000 rows sent to SQL Server. Total sent: 27000
1000 rows sent to SQL Server. Total sent: 28000
1000 rows sent to SQL Server. Total sent: 29000
bcp import completed!
BULK INSERT
Next, we have BULK INSERT given the same format file from bcp
CREATE TABLE zips (
Col1 nvarchar(50),
Col2 nvarchar(50),
Col3 nvarchar(50),
Col4 nvarchar(50),
Col5 nvarchar(50),
Col6 nvarchar(50),
Col7 nvarchar(50),
Col8 nvarchar(50)
GO
INSERT INTO zips
SELECT *
FROM OPENROWSET(BULK 'C:Documents and SettingstkruegerMy Documentsblogcenzuszipcodeszips.txt',
FORMATFILE='C:Documents and SettingstkruegerMy Documentsblogzip_format_file.txt'
) as t1 ;
GO
That was simple enough given the work on the format file that we already did. Bulk insert isn’t as fast as bcp but gives you some freedom from within TSQL and SSMS to add functionality to the import.
SSIS
Next is my favorite playground in SSIS
We can do many methods in SSIS to get data from point A, to point B. I’ll show you data flow task and the SSIS version of BULK INSERT
First create a new integrated services project.
Create a new flat file connection by right clicking the connection managers area. This will be used in both methods
Bulk insert
You can use format file here as well which is beneficial to moving methods around. This essentially is calling the same processes with format file usage. Drag over a bulk insert task and double click it to go into the editor.
Fill in the information starting with connection. This will populate much as the wizard did.
Example of format file usage
Or specify your own details
Execute this and again, we have some data
Data Flow method
Bring over a data flow task and double click it to go into the data flow tab.
Bring over a flat file source and SQL Server destination. Edit the flat file source to use the connection manager “The file” we already created. Connect the two once they are there
Double click the SQL Server Destination task to open the editor. Enter in the connection manager information and select the table to import into.
Go into the mappings and connect the dots per say
Typical issue of type conversions is Unicode to non-unicode.
We fix this with a Data conversion or explicit conversion in the editor. Data conversion tasks are usually the route I take. Drag over a data conversation task and place it between the connection from the flat file source to the SQL Server destination.
New look in the mappings
And after execution…
SqlBulkCopy Method
Sense we’re in the SSIS package we can use that awesome “script task” to show SlqBulkCopy. Not only fast but also handy for those really “unique” file formats we receive so often
Bring over a script task into the control flow
Double click the task and go to the script page. Click the Design script to open up the code behind
Ref.
Ahsan Kabir Please remember to click Mark as Answer and Vote as Helpful on posts that help you. This can be beneficial to other community members reading the thread. http://www.aktechforum.blogspot.com/

SQL table or Txt file as target

Similar Messages

Maybe you are looking for