Flat File in Unix to DB in Windows
HI
As part of POC I am trying to interface from a flat file in Unix server to a Oracle DB in Windows machine.
I can access the file in Unix box using telnet/FTP. The directory and the file has rw-rw-rw- permissions.
I have ODI installed in Windows machine. I do not have an agent or anything installed in Unix machine.
When the file is in Windows machine, I am able to interface data as required. But, when I try with file on unix machine, I get directory does not exist. I tried both absolute path using $HOME/<directory>.
Is it possible to achieve such integration or is it mandatory to install ODI Standalone Agent (at least) on the unix machine.
Regards,
G V Ranjith
Another option without installing the Unix agent is to install the samba share on the Unix and access that from Windows.
This post will help you:
Re: File not able to see in designer
Similar Messages
-
Is there ODBC driver for excel flat file in Unix Box
Hello guys
I have a question about importing flat file sitting on Unix box into OBIEE. Normally, if the file is somewhere in Windows, I could just use a DSN for text file where I can set the location of the flat file and then be able to import using admin tool.
However, if the file is sitting on the unix box, I wouldn't be able to define the path using that DSN driver since the location of the file doesnt belong to C: drive or E: drive like it does in Windows.
So in this case, how would i be able to proceed? What third party ODBC could I use for flat file in Unix? Also, there is a file called ODBC.INI in Unix OBIEE directory, do I have to modify the content of that file too? If so how would I do it in order to be able to import flat file from Unix using Admin tool?
Your thoughts?
ThanksYou'd need to export the Excel file to CSV or something like that, and then read it in from there.
Thanks rnm.
I am more curious about what you said above.. Could you explain a little more?
Do you mean changing the flat file into CSV format? If so, the flat would still be in Unix location after the changing right? Or am I not understanding you completely?
Thanks and please advice
Cheers -
Online program to create a flat file on Unix
Hi All,
Good day.
I got one requirement, where I need to write a Online program that will create a flat file on Unix. The probable Unix file will be send from the selection screen, where the user selects that with a fixed length & format.
Do I need to do it with the Datasets? or is it possible to go with Upload function modules?
Please, send one example program of such kind.
Thanks,
Kal ChandHi,
You are going to create a flat file in the Unix Operating system which is nothing but the application server.
There are no standard function modules to write the file in the application server, so you need to use the DATA SET concept only.
1. Open Data Set file name
2. Transfer Data Set file name
3. close Data set file name
I believe this will help you to finish your requirement.
Thanks,
Mahesh. -
Sample code to read a text file from UNIX directory.
I am using 9i Developer Suite, application server is 9.0.4. I want some help on how to read a flat file from UNIX environment. A sample code could be very helpful.
In windows, i use this kind of code:-
I declare an object & then write to a file using these sample staements:-
file_handle text_io.file_type;
filename := 'd:\ran\egs\uninvoiced.txt';
file_handle:=text_io.fopen(filename,'w');
text_io.put_line(file_handle, 'MOBILE NO '||'COUPON NO ' || 'DATE');
I hope, my question is clear. Please help in solving the doubt.
Regards.filename := 'd:\ran\egs\uninvoiced.txt';This is a Windows directory, so it won't work on Unix.
For the rest of the code: see examples in the Forms Builder Online Help. -
Hi All,
we have been using OWB 10.2.0.3 version from past 6 months till now we are loading database to database.
Data base version : 10.2.
OWB version : 10.2.0.3
Server operating system : Sun Solaries (10)
Client operating system : Windows Xp.
I would like to share some information to u and all.
i have installed owb10gr2 on personal PC it has windows Xp operating system. i have one simple mapping for FLAT file.
Steps handled by me to populate data flat file to Database.
i have created one folder in C drive then i have created directory and i gave privilages to access that folder.
i have created external table for flat file manually.
after that i imported external table to mapp target table. it's working fine and data also loading.
i am still getting confuse Flat file handling with SUN SOLARIES OPERATING SYSTEM
How do we handle flat file in UNIX environment.
How create directory and how to give access privilages.
how to create EXTERNAL table with OWB.
Could u please help me
Regards.
venkat.Hi,
i have logged in sys and i created directory then gave privilages to 'c:\test_file'.... test_file is folder name which i created folder in windows PC. server is SUNSOLARIS.
in OWB i have created table based on that file with delimited. below mentioned column names and values.
no name sal coom
100 aa 10000 1000
200 bb 20000 2000
300 cc 30000 3000
400 dd 40000 4000
after that i have created external table under source module and then deployed that table in database table has created sucessfully but while using select statement it's showing error.
ex: select * from table ( error)
ORA-29913 error in executing ODCIEXTTABLEOPEN callout
ORA-29400 data cartridge error
KUP-04040 file abc.csv in test_v_s_loc not found
ORA-06512 at "sys.ORACLE_LOADER",line 19
i have done/given privilages like below
create or replace directory sample_owb as 'C:\test_file'
grant read,write on directory sample_owb to ods_inb_stg
what is the cause and how to handle and resolve. could u please help me.
regards,
venkat. -
How to run a JAR file in Unix system?
hi there
ca anyone tell me how to run a JAR file in unix system or X window, thank youYou want to create an executable JAR file? You do it in the following way.
Create a manifest file such as manif.txt and the contents should contain
Main-Class: foo
assuming foo is the name of your main class. Then create the jar as follows
jar cvfm foo.jar manif.txt foo.class
I hope that helps you!
you can find more info here http://java.sun.com/docs/books/tutorial/jar/ -
Positional Flat File Handling in B2B
Problem:
There is a big problem with handling positional flat files in Oracle B2B. We are trying to handle Positional Flat File, in UTF-8 with BOM encoding, after creating document definition and setting the agreement, we received:
B2B-51507 Error: The data starting at position 0 is not recognized as a valid data transmission.
What’s more, we remembered to locate Parser file into Config/schema location, which usually fixes problem.
Full description:
We have a sample flat file, with UNIX (LF) endline character, encoded in UTF-8 with BOM:
11B6Kamil Mazur Lazurowa 8 12 CityABCD PL
Junior Consultant MyCompanyX
StreetAAAAAA 00-000 CityABCD
First of all, we have created a guideline *.ecs and schema XSD, like that:
imgur: the simple image sharer
During XSD creation we have remembered to confirm, that our endline character is in UNIX standard (LF).
After that, we have created Parser Schema File, and paste it in the schema location in our server:
/oracle/Middleware/MyDomain/soa/thirdparty/edifecs/XEngine/config/schema,
after that we paste the schema location in XRegistry file:
imgur: the simple image sharer
After that action, we restarted SOA Server (which was running during these changes).
When SOA Server was in alive again, we’ve created a document definition :
imgur: the simple image sharer
Starting and Ending positions are from 2-5, because of BOM character existence. Then, we created Trading Partner and Inbound Agreement, based on this Document Definition:
imgur: the simple image sharer
Then we posted out test file via Generic File Listening Channel, with no Java Callout and other properties. Unfortunately, we receive error like this:
Business Message :
Id
AC18017B146145ADDCD00000178AA4F9
Message Id
AC18017B146145ADDCB00000178AA4F8-1
Refer To Message
Refer To Message
Sender Type
Name
Sender Value
Szkolenie
Receiver Type
Name
Receiver Value
MyCompany
Sender
Szkolenie
Receiver
MyCompany
Agreement Id
PersonIn
Agreement
PersonIn
Document Type
Person
Document Protocol
PositionalFlatFile
Document Version
Logistics2013
Message Type
REQ
Direction
INBOUND
State
MSG_ERROR
Acknowledgement Mode
NONE
Response Mode
ASYNC
Send Time Stamp
2014-05-19 14:00
Receive Time Stamp
2014-05-19 14:00
Document Retry Interval(Channel)
0
Document Remaining Retry(Channel)
0
Document Retry Interval(Agreement)
Document Remaining Retry(Agreement)
Native Message Size
141
Translated Message Size
Business Action Name
Business Transaction Name
Xpath Name1
Xpath Value1
Xpath Expression1
Xpath Name2
Xpath Value2
Xpath Expression2
Xpath Name3
Xpath Value3
Xpath Expression3
Correlation From XPath Name
Correlation From XPath Value
Correlation From XPath Expression
Correlation To XPath Name
Correlation To XPath Value
Correlation To XPath Expression
Wire Message
Wire Message
Application Message
Application Message
Payload Storage
Payload Storage
Attachment
Attachment
Label
soa_b2b_ - Thu May 15 15:04:40 CEST 2014 - 1
Collaboration Id
AC18017B146145ADD9200000178AA4F7
Collaboration Name
Collaboration Version
Business Action Name
Exchange Protocol Name
Generic File
Exchange Protocol Version
1.0
Interchange Control Number
Group Control Number
Transaction Set Control Number
Error Code
B2B-51507
Error Description
Machine Info: (soatest.corp.prv) The data starting at position 0 is not recognized as a valid data transmission.
Error Level
ERROR_LEVEL_COLLABORATION
Error Severity
ERROR
Error Text
Payload validation error.
Wire Message:
Id
AC18017B146145ADAB400000178AA4F1
Message Id
AC18017B146145ADAB400000178AA4F1
Business Message
AC18017B146145ADDCD00000178AA4F9
Packed Message
Packed Message
Payload
Payload
Protocol Message Id
test_4value.txt@AC18017B146145ADAE500000178AA4F5
Refer To Protocol Message Id
Protocol Collaboration Id
Protocol Transport Binding
filename=test_4value.txt filesize=143 ChannelName=SzkolenieChannel file_ext=txt fullpath=/home/oracle/POC/positional/Krzysiek/test_4value.txt timestamp=2014-05-07T10:23:30.000+01:00 tp_profile_name=Szkolenie MSG_RECEIVED_TIME=Mon May 19 14:00:37 CEST 2014
Message Digest
Message Digest
Digest Algorithm
Transport Protocol
File
Transport Protocol Version
1.0
Url
file://localhost//home/oracle/POC/positional/Krzysiek
security
Transport Headers
filename=test_4value.txt filesize=143 ChannelName=SzkolenieChannel file_ext=txt fullpath=/home/oracle/POC/positional/Krzysiek/test_4value.txt timestamp=2014-05-07T10:23:30.000+01:00 tp_profile_name=Szkolenie MSG_RECEIVED_TIME=Mon May 19 14:00:37 CEST 2014
certificates
certificates
State
ERROR
Reattempt Count
Error Code
B2B-51507
Error Description
Machine Info: (soatest.corp.prv) The data starting at position 0 is not recognized as a valid data transmission.
Error Text
Payload validation error.
exchange Retry Interval
exchange Remaining Retry
Message Size
141
Payload seems to be unchanged. Problem appears, when our B2B works in Cluster (but both configuration parameters b2b.HAInstance b2b.HAInstanceName are set properly for both soa-servers):
imgur: the simple image sharer
There are no additional info in logs :
[2014-05-19T14:07:47.994+02:00] [soa_server1] [NOTIFICATION] [] [oracle.soa.b2b.engine] [tid: DaemonWorkThread: '20' of WorkManager: 'wm/SOAWorkManager'] [userId: <anonymous>] [ecid: a8bc74c6eb84aa5b:452af1da:146046c88de:-8000-00000000000598a0,0] [APP: soa-infra] Engine: processIncomingMessageImpl: Message id = AC18017B14614616E1A00000178AA510-1 FromParty = Szkolenie Doctype = Person version = Logistics2013
That’s unfortunately all. Is there any configuration that we missed? How to fix this problem?Hi Anuj,
I have added a transformation in the mediator component and I'm now able to transfer the opaque data from Oracle B2B to composite and then write the contents of flat file to another specified file thorugh file adapter.
However I still have few more issues in different scenarios:
I have tried the excercise that was mentioned in your blog:
http://www.anuj-dwivedi.blogspot.com/2011/10/handling-positionaldelimited-flat-files.html
I tried to create a flat file with two records or lines as mentioned in the blog. First line contains header information whose length is 57 characters with 5 Fileds in it. Second line contains the actual data with 57 characters and 5 fields in it. In the agreement that was created to handle this flat file, I have checked the Validate & Translate check box.
During validation, B2B is failing to treat the second line as a new record and it considering it in one record and the validation is failing as nothing is specified from 58th character in the ECS & XSD files.
Following is the error:
Error -: B2B-51507: Payload validation error.: Machine Info: (corpdevsoa10) Extra Field was found in the data file as part of Record HEADER. Record HEADER is defined in the guideline at position 1.{br}{br}This error was detected at:{br}{tab}Record Count: 1{br}{tab}Field Count: 6{br}{tab}Characters: 57 through 116
Please advice me in resolving this issue.
Thanks,
Krishna. -
Running reports on Flat file schemas when OBIEE server is on Unix
Hello
we would like to know how Unix OBIEE work with flat file. Currently, in our environment our Development and Production OBIEE are running on Unix AIX machine while our local OBIEE environment is on Windows.
As our devolepment and configuration goes, we have encounter situations where the flat file schema that were working well on Windows OBIEE server will not run on Unix. The flat files are located on a windows file directory and could be successfully imported into OBIEE throu Admin Tool.
However, when updating rowcounts or running reports on answers in Unix OBIEE it would return errors:
State: HY000. Code: 472983136. [NQODBC] [SQL_STATE: HY000] [nQSError: 10058] A general error has occurred. [nQSError: 16023] The ODBC function has returned an error. The database may not be available, or the network may be down. (HY000)
The same activity is working fine on our local machine when OBIEE is on windows..
We would like to get some help on how to work with flat files when OBIEE is runing on Unix..is this the same question as [this one|http://forums.oracle.com/forums/message.jspa?messageID=4018049#4018049] ?
-
To read flat file from a unix server
We need to read a flat file from a Unix server, where our Database is located.
The location gets created correctly.
But while we are trying to import files from the location in Design Center , we get an error that "directory does not exists", although the directory has all the permissions.
Can someone please suggest how should we create the location so as it can read the files.
Please Reply ASAP......We have started Design Center on a local machine(Windows Machine) with uaer as repository owner of the server,
In the design center we can not sample the file till we import it,
can you please tell how to sampe the file without importing it.
Also a location pointing to server location gets easily created on the design center and the file module points to that location only, but when we try to import the file through that location, it says directory does not exists, although oracle user has all the read write permissions on the directory......
Please help! -
Migrating flat file in OBIEE from Windows to AIX
Hello guys
I have a rpd built in my local windows environment and now it is ready to be pushed into Dev environment.. In my rpd, I have some flat files imported and configure for reporting, and the files are located in a windows directory..
My concern is, after migrating my rpd to Dev environment, since the DEV OBIEE server is running on AIX server, it may disconnect from flatfile DB in windows and result in no being able to report against the flat file..
Have you guys ever encounter such case? and how do you go about dealing with it?
Your thoughts are much appreciated
Thank youMark,
You should be able to binary transfer the fmb / pll across and then recompile.
Anything windows specific would be a show stopper, otherwise I haven't had problems (also going back from Link to Windows) - but then my Forms are usually pretty simple.
The biggest pain is case sensitivity - Unix is and Windows isn't. You should standard all file names if you can and the biggest pain are the attached libraries - especially with Designer Generated Forms as one of them is InitCapped somewhere. For this I usually have to create an FMT / PLD and see what the form thinks the library is actually called in the attachment. Have fun!
HTH
Steve -
Handling variable flat file name in UNIX environment
Dear Forum,
I am working in a project where,
Online systems generate flat files with variable names (followed by timestamp) and load into a Unix directory (FTP Location) for loading into data warehouse.
Using OWB, I will have to rename those files into a static name then execute the mapping. Once the mapping is executed the the source file should be transfered to a different directory.
I am trying to do this using a external process in OWB process flow. I found a similar reference in the link below
http://www.oracle.com/technology/products/warehouse/pdf/Cases/case7.pdf
But here it is shown for windows only. As I do not know unix, I could not proceed a lot with this.
Therefore requesting you all, please help me showing how can I achive this. I think your answer will help many others along with me, looking for the same solution. Please help.
Kind Regads
ZakirYou will need to logon as your Oracle owner (the userid is ORACLE, in my case), and then issue the following commands from a terminal session:
To create a new reports server (one in addition to the default
in-process server), use the following commands:
export ORACLE_HOME=<whatever your oracle home path is>
cd $ORACLE_HOME/bin
./rwserver.sh <newserver name>
To start the new server, issue:
./rwserver.sh server=<newserver name>
Leave the Unix session that was used to start the server logged on unless you have something like DTWM running that will keep the server running. Otherwise, if you log off the unix session, the server will end.
Then just substitute the new server name in your line command. The difference between the in-process server and a standalone server is that the in-process server will not always stay active - it will start when it receives a request. The standalone server will stay active all the time and wait for requests.
If the standalone server works for you, I would suggest then putting it in the correct config files to let Enterprise Manager manage it for you. If you get that far, let me know and I can tell you how to do that also. (Plus the instructions are in the Publishing Reports To The Web manual). -
How to access a file in Unix server from windows using java
I want to access a file in unix server from windows using java program.
I have the following code. I am able to open the url in a web browser.
String urlStr="ftp:user:passwd@unix-server:ftp-port//javatest/test.csv;type=i";
URL url = new URL(urlStr);
BufferedReader in = new BufferedReader(new InputStreamReader(url.openStream)));
String inputLine;
while((inputLine=in.readLine()))!=null){
System.out.println(inputLine);
in.close();
I get the following error
java.io.FileNotFoundException: /javatest/test.csv
at sun.net.www.protocol.ftp.FtpURLConnection.getInputStream(FtpURLConnection.java:333)
at java.net.URL.openStream(URL.java:960)
at com.test.samples.Test.main(Test.java:45)urlStr="ftp:user:passwd@unix-server:ftp-port//javatest/test.csv;type=i";
I have given the format of the urlStr that I am using in the code. The actiual values are used in my code. I have tried pasting this url in the browser and it opens the file. -
Unix Flat File: Remove header and trailer and put in another file.
Hi,
I have Source Flat File placed on Unix Box with header and trailer.
I want to remove Header and Trailer and put in some other file and Data in another file.
I tried following command in unix its working.But not getting Header and Trailer in another file.
sed '1d;$d' input_source.txt > output_data.txt
also How will i use OS command for it in ODI.
Guide me.
Thanks
AshwiniHi Ashwini,
You can run OS commands in a package using an ODI Tool: OdiOSCommand.
It is also possible to execute OS commands in an ODI procedure using the Operating System or Jython technologies.
There should be some articles about this on metalink (http://metalink.oracle.com).
Thanks,
Julien -
Scheduling unix shell scripts from windows using DOS batch files
Hi,
I want to schedule unix shell scrips using windows scheduled. I have the option of scheduling the DOS batch files. But not able to connect to telnet using DOS. Please let me know if there is an option.
Regards,
-AnandDrive letters are user specific. When you run jboss it runs as you, with your shared drives. When you run it as a service, it runs as guest or another user so your drive letters are meaningless.
Either setup the user or use UNC -
Transfer file from UNIX to windows application server G:\ drive
Dear Expert,
Really need some help on this, very urgent !
The download program schedule in background to allow file store in unix.
Can we do a unix command in abap program to transfer the file from unix to windows application server G:\ drive.
The gateway for that application server is ukblmqg02.emea.astrazeneca.net .
Anyone have the sample source code ?
Thanks®ards
NislinaHi,
1.
There is a FM 'ARCHIVFILE_SERVER_TO_CLIENT'.
If the requirement need not necessarily require a FM to transfer a file, then you can also use transaction 'CG3Y' to transfer a file
from application server to presentation server.
2.
Try to use FM DOCFILE_SERVER_TO_CLIENT. I am using it to download a file from SAP application server to desktop.
Source path should be application server file path along with file name i.e. /tmp/sample.xls.
Target path should be something like c:\file.xls.
Best regards,
Prashant
Maybe you are looking for
-
How do I download music from my PC to the I phone 5
I find nothing in the tutorials or user manuel for downloading from your PC to the Iphone5. All it talks about is BUYING from ITunes.
-
I used to have the option of distributing objects so that they would overlap, but the current "distribute" tool is functioning as if overlapping isn't allowed. The result is that the objects move beyond the limits of the slide. Any suggestions?
-
Today I have started to get a pop up message on my iPad 2. It says "one item could not be synced, see iTunes for info". The problem is, I don't get that message on my computer, or any other device, besides my iPad. It only happens when I open iTunes,
-
Why does everything look perfect in preview browsers firefox and IE but not online?
Hi, I have spent a couple months creating a website and checking all the pages on the preview browser and all the pages looked great. I finally put all the files to the server and online and the formatting is messed up on portions of every page. Ye
-
Can't print on air printer from my ipad at friends house
How do I print from my iPad on my friends air printer.