Data extraction with PL/SQL

Hi Expert
My customer wants to use PL/SQL language for SAP data extraction in Oracle database. He doesnt want to use ABAP code for this.
In my opinion I think that its not correct to do this but I have no solid argument.
Could anyone explain to me why its not advisable to use the ORACLE database directly for this data extraction?
Best regards

Hi,
PL SQL(Native SQL) statements bypass the R/3 database interface. There is no table logging, and no synchronization with the database buffer on the application server. For this reason, you should, wherever possible, use Open SQL(ABAP SQL) to change database tables declared in the ABAP Dictionary. In particular, tables declared in the ABAP Dictionary that contain long columns with the types LCHR or LRAW should only be addressed using Open SQL, since the columns contain extra, database-specific length information for the column. Native SQL does not take this information into account, and may therefore produce incorrect results. Furthermore, Native SQL does not support automatic client handling. Instead, you must treat client fields like any other.
I think this will be useful for you
a®

Similar Messages

How to connect Data Services with microsoft SQL/ Steps

Dear All,
i attend to connect the SAP BO Data Services to Microsoft SQL.
1. Is there any document which explains the steps to follow?
2. Is there any document how to build a prototyp
Thank you.
Pat.

Hi Aditya,
You can use a datastore of type ODBC using the IBM Client Access driver or the DataDirect driver that comes packaged with Data Services. There is a sticky thread on downloading the DataDirect driver. There is also another option to connect with the Attunity driver for the AS400. You cannot use the DB2 UDB drivers to connect to the AS400 V6R1.
Victor

Cannot create XA data source with MS SQL

Hello,
I am currently trying to create a datasource with he XA transactions support. The exception is the same when I'm using the SYSTEM_DRIVER (NetWeaver is using the MS SQL 2005) and when I'm using the user-defined MS SQL JDBC driver. The 'regular' (using tag <jdbc-1.x>) datasources are successfully created, the problem appears only for the XA one.
This is the part of my data-sources.xml responsible for this data source:
<data-source>
        <data-source-name>DataSource/SCP</data-source-name>
        <driver-name>SYSTEM_DRIVER</driver-name>
        <init-connections>5</init-connections>
        <max-connections>25</max-connections>
        <sql-engine>Vendor_SQL</sql-engine>
        <jdbc-2.0>
            <xads-class-name>com.microsoft.sqlserver.jdbc.SQLServerXADataSource</xads-class-name>
            <object-factory>com.microsoft.sqlserver.jdbc.SQLServerDataSourceObjectFactory</object-factory>
           <properties>
                <property>
                    <property-name>serverName</property-name>
                    <property-value>localhost</property-value>
                </property>
                <property>
                    <property-name>databaseName</property-name>
                    <property-value>SCP</property-value>
                </property>
                <property>
                    <property-name>port</property-name>
                    <property-value>1433</property-value>
                </property>
                <property>
                    <property-name>user</property-name>
                    <property-value>myUser</property-value>
                </property>
                <property>
                    <property-name>password</property-name>
                    <property-value>myPassword<property-value>
                </property>
            </properties>
        </jdbc-2.0>
    </data-source>
Below you can see the stacktrace that appears in the defaultTrace_00.trc:
Text: [ERROR CODE DPL.DS.5029] Exception in operation startApp with application se.sync/BPE.
Reason : [ERROR CODE DPL.DS.5029] Exception in operation startApp with application se.sync/BPE.
[EXCEPTION]
com.sap.engine.services.deploy.exceptions.ServerDeploymentException: [ERROR CODE DPL.DS.5029] Exception in operation startApp with application se.sync/BPE.
     at com.sap.engine.services.deploy.server.application.ApplicationTransaction.rollbackPart(ApplicationTransaction.java:521)
     at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesOnOneServer(ApplicationTransaction.java:422)
     at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhases(ApplicationTransaction.java:445)
     at com.sap.engine.services.deploy.server.application.ParallelAdapter.super_MakeAllPhases(ParallelAdapter.java:337)
     at com.sap.engine.services.deploy.server.application.StartTransaction.makeAllPhasesImpl(StartTransaction.java:550)
     at com.sap.engine.services.deploy.server.application.ParallelAdapter.runInTheSameThread(ParallelAdapter.java:251)
     at com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesAndWait(ParallelAdapter.java:392)
     at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationAndWait(DeployServiceImpl.java:3389)
     at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationAndWait(DeployServiceImpl.java:3375)
     at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationAndWait(DeployServiceImpl.java:3278)
     at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationAndWait(DeployServiceImpl.java:3251)
     at com.sap.engine.services.dc.lcm.impl.J2EELCMProcessor.doStart(J2EELCMProcessor.java:99)
     at com.sap.engine.services.dc.lcm.impl.LifeCycleManagerImpl.start(LifeCycleManagerImpl.java:62)
     at com.sap.engine.services.dc.cm.deploy.impl.LifeCycleManagerStartVisitor.visit(LifeCycleManagerStartVisitor.java:34)
     at com.sap.engine.services.dc.cm.deploy.impl.DeploymentItemImpl.accept(DeploymentItemImpl.java:83)
     at com.sap.engine.services.dc.cm.deploy.impl.DefaultDeployPostProcessor.postProcessLCMDeplItem(DefaultDeployPostProcessor.java:80)
     at com.sap.engine.services.dc.cm.deploy.impl.DefaultDeployPostProcessor.postProcess(DefaultDeployPostProcessor.java:56)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImpl.doPostProcessing(DeployerImpl.java:741)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImpl.performDeploy(DeployerImpl.java:732)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImpl.doDeploy(DeployerImpl.java:576)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImpl.deploy(DeployerImpl.java:270)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImpl.deploy(DeployerImpl.java:192)
     at com.sap.engine.services.dc.cm.deploy.impl.DeployerImplp4_Skel.dispatch(DeployerImplp4_Skel.java:875)
     at com.sap.engine.services.rmi_p4.DispatchImpl._runInternal(DispatchImpl.java:351)
     at com.sap.engine.services.rmi_p4.server.ServerDispatchImpl.run(ServerDispatchImpl.java:70)
     at com.sap.engine.services.rmi_p4.P4Message.process(P4Message.java:62)
     at com.sap.engine.services.rmi_p4.P4Message.execute(P4Message.java:37)
     at com.sap.engine.services.cross.fca.FCAConnectorImpl.executeRequest(FCAConnectorImpl.java:877)
     at com.sap.engine.services.rmi_p4.P4Message.process(P4Message.java:53)
     at com.sap.engine.services.cross.fca.MessageReader.run(MessageReader.java:58)
     at com.sap.engine.core.thread.execution.Executable.run(Executable.java:108)
     at com.sap.engine.core.thread.execution.CentralExecutor$SingleThread.run(CentralExecutor.java:304)
Caused by: com.sap.engine.services.dbpool.exceptions.BaseDeploymentException: Cannot create DataSource "DataSource/SCP".
     at com.sap.engine.services.dbpool.deploy.ContainerImpl.startDataSources(ContainerImpl.java:1467)
     at com.sap.engine.services.dbpool.deploy.ContainerImpl.prepareStart(ContainerImpl.java:468)
     at com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:219)
     at com.sap.engine.services.deploy.server.application.StartTransaction.prepare(StartTransaction.java:179)
     at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesOnOneServer(ApplicationTransaction.java:420)
     ... 30 more
Caused by: java.lang.NullPointerException
     at java.lang.Class.forName0(Native Method)
     at java.lang.Class.forName(Class.java:164)
     at com.sap.engine.services.dbpool.deploy.ContainerImpl.startDataSources(ContainerImpl.java:1394)
     ... 34 more
When I'm looking at the \usr\sap\EE5\J00\exe\mssjdbc\sqljdbc.jar file, I can see both these classes (SQLServerXADataSource and SQLServerDataSourceObjectFactory), so the problem is probably somewhere else. As the exception comes from the native method - does it mean, that the XA extension is not installed correctly on the server (as described [here|http://technet.microsoft.com/en-us/library/aa342335(SQL.90).aspx])?
Thanks for any help!
Best Regards,
-Milosz

Ok, just to share - the solution was as follows:
remove the object-factory element
change property name "port" to "portNumber"
So, the correct data-sources.xml is as follows:
<data-source>
     <data-source-name>DataSource/SCP</data-source-name>
     <driver-name>SYSTEM_DRIVER</driver-name>
     <init-connections>5</init-connections>
     <max-connections>25</max-connections>
     <sql-engine>Vendor_SQL</sql-engine>
     <jdbc-2.0>
         <xads-class-name>com.microsoft.sqlserver.jdbc.SQLServerXADataSource</xads-class-name>
         <properties>
             <property>
                 <property-name>serverName</property-name>
                 <property-value>localhost</property-value>
             </property>
             <property>
                 <property-name>databaseName</property-name>
                 <property-value>SCP</property-value>
             </property>
             <property>
                 <property-name>portNumber</property-name>
                 <property-value>1433</property-value>
             </property>
             <property>
                 <property-name>user</property-name>
                 <property-value>myUser</property-value>
             </property>
             <property>
                 <property-name>password</property-name>
                 <property-value>myPassword<property-value>
              </property>
         </properties>
     </jdbc-2.0>
</data-source>
And this works.

Can anybody explain about MM data extraction with steps.

Hai everybody!
Right now i got an opportunity to work with MM datasource extraction by using LO cockpit in BI7.0. But I never worked in this
module.Pls can anybody explain how can i deal this datasource
and how can i migrate data into SAP BI. Pls give steps and explanation.
Warm Regards
Ravi.

Hi,
Pls search SDN BI forum, you will get a lot of info about this.
http://www.sap-img.com/business/lo-cockpit-step-by-step.htm
/community [original link is broken]
/people/sap.user72/blog/2004/12/16/logistic-cockpit-delta-mechanism--episode-one-v3-update-the-145serializer146
LOGISTIC COCKPIT DELTA MECHANISM - Episode two: V3 Update, when some problems can occur...
LOGISTIC COCKPIT DELTA MECHANISM - Episode three: the new update methods
LOGISTIC COCKPIT - WHEN YOU NEED MORE - First option: enhance it !
LOGISTIC COCKPIT: a new deal overshadowed by the old-fashioned LIS ?
Regards
CSM Reddy

Gap in data extracted with 2LIS_13_VDITM

I have an issue with the 2lis_13_vditm extractor in R/3. When I initialize the delta, it selects data through 10/14/05 and will not select the data from that date to current. Subsequently, when I run a delta load, I get only changes made since the initialization (as I would expect). There are no selections made on the data package to limit the data selected.
Is there something else I should be looking at? When I run the extractor in test mode in R/3 for the period that is missing, it returns no data.
Could this be related to the fact that the extractor was activated in LBWE in October of last year and we are now getting around to using it. I have set up the Job Control, but it does not seem to move any of the missing data. The structure is set to V2 Updating.
Thanks in advance.

Kevin
The reason why data prior to 10/14/05 is that data earlier to this date is either archieved or while filling set up table data is filled from date 10/14/05 so this is the reason why data prior 10/14/05 is not available.
Data from set up tables of 2LIS_13_VDITM also been deleted after the initial load to allocate more space for other bigger data sources, that is the reason when you are trying to see data in in the RSA3 for this datasource u can't see any data.
The reason why data is deleted from set up table's after initil load in the BW system is that it actually pulls data from R/3 and stores there, this datasource being related to biling items takes huge database/memory space making memory allocation difficult for other datasources
so to avoid this database/memory crunch with limited avaialable database/memory resources, data from such big size setup tables is normally deleted after initial laod is done in BW systeme with respect to this datasource.
Hope this resovles your doubt.
kindly assign the points if it helps.
revert back if u need futher help/information.
regards,
sunil.

Data extraction for BW/BI

Hi ,
I am new in BW.Can anyone send me material on DATA EXTRACTION IN BW? I mainly want the material for LO-extraction.If anyone could provide the material on extractors like LO-cockpit,Generic data source etc.I will be really thankful.Please send the material at "baljinder4u_gmail.com" .
Thanks in advance

Hi Rakesh
Step-by-step control flow for a successful data extraction with SAP BW:
   1. An InfoPackage is scheduled for execution at a specific point of time or for a certain system- or user-defined event.
   2. Once the defined point of time is reached, the SAP BW system starts a batch job that sends a request IDoc to the SAP source system.
   3. The request IDoc arrives in the source system and is processed by the IDoc dispatcher, which calls the BI Service API to process the request.
   4. The BI Service API checks the request for technical consistency. Possible error conditions include specification of DataSources unavailable in the source system and changes in the DataSource setup or the extraction process that have not yet been replicated to the SAP BW system.
   5. The BI Service API calls the extractor in initialization mode to allow for extractor-specific initializations before actually starting the extraction process. The generic extractor, for example, opens an SQL cursor based on the specified DataSource and selection criteria.
   6. The BI Service API calls the extractor in extraction mode. One data package per call is returned to the BI Service API, and customer exits are called for possible enhancements. The extractor takes care of splitting the complete result set into data packages according to the IDoc control parameters. The BI Service API continues to call the extractor until no more data can be fetched.
   7. The BI Service API finally sends a final status IDoc notifying the target system that request processing has finished (successfully or with errors specified in the status IDoc).
Note
Control parameters specify the frequency of intermediate status IDocs, the maximum size (either in kilobytes or number of lines) of each individual data package, the maximum number of parallel processes for data transfer, and the name of the application server to run the extraction process on.
*Here is LO Cockpit Step By Step*
LO EXTRACTION
- Go to Transaction LBWE (LO Customizing Cockpit)
1). Select Logistics Application
       SD Sales BW
            Extract Structures
2). Select the desired Extract Structure and deactivate it first.
3). Give the Transport Request number and continue
4). Click on `Maintenance' to maintain such Extract Structure
       Select the fields of your choice and continue
             Maintain DataSource if needed
5). Activate the extract structure
6). Give the Transport Request number and continue
- Next step is to Delete the setup tables
7). Go to T-Code SBIW
8). Select Business Information Warehouse
i. Setting for Application-Specific Datasources
ii. Logistics
iii. Managing Extract Structures
iv. Initialization
v. Delete the content of Setup tables (T-Code LBWG)
vi. Select the application (01 u2013 Sales & Distribution) and Execute
- Now, Fill the Setup tables
9). Select Business Information Warehouse
i. Setting for Application-Specific Datasources
ii. Logistics
iii. Managing Extract Structures
iv. Initialization
v. Filling the Setup tables
vi. Application-Specific Setup of statistical data
vii. SD Sales Orders u2013 Perform Setup (T-Code OLI7BW)
        Specify a Run Name and time and Date (put future date)
             Execute
- Check the data in Setup tables at RSA3
- Replicate the DataSource
Use of setup tables:
You should fill the setup table in the R/3 system and extract the data to BW - the setup tables is in SBIW - after that you can do delta extractions by initialize the extractor.
Full loads are always taken from the setup tables
please follow the link
https://www.sdn.sap.com/irj/sdn/advancedsearch?query=dataEXTRACTIONIN+BW&cat=sdn_all
Regards
Tapashi
Edited by: Tapashi Saha on Aug 18, 2008 11:03 AM

[sap-bw] SAP HR data extraction errors....into BI 7.0 ...from ECC 6.0..

Hi Gurus,
We are doing HR data extraction with the following details:
Cube: 0PT_C01 - Time and Labor
data source: 0HR_PT_1 - Times from personal work schedule
Records in ECC: 15mill +.
"Init load with Data "is being loaded in packets of 40K records (400 packets approx).
Each time we load (we tried reloading after deleting data and reinit) it is loading same records. But it is giving the following error. Surprisingly this error is coming for different packets in different loads. for ex: 1st time packet 6...2nd time packet 58....3rd time 122 etc.....it keeps changing...
Processing end : Errors occurred
Error when generating the update program
Diagnosis
An error occurred during program generation for InfoSource 0HR_PT_1 and
InfoProvider 0PT_C01 . This may be extrapolated to incorrect update
rules.
Procedure
Check and correct your update rules and then generate the update program
again. You can find help on the error in the error log.
We reactivated and verfieid update rules. But no use.
Appreciate any kind of help.
thanks in advance.
J.

Oscar,
Thanks for the help.
We tried the following one by one.
1. Delete and recreate update rules. To be frank....there is no CODING or complication in there...
     It did not work.
2. Tried loading only to PSA. It loaded 15mill records perfectly. But when we tried updating target cube,
    same story with many more errors.....earlier we had 10 packages failed out of 387.......
     this time almost every alternate package is marked red and same error....update generating update
     program.....
Hope somebody will come up with a solution.

Dynamic Date dimensions in MS Sql Server 2005

Environment : BO 4 SP3
Database : MS Sql 2005
Trying to create dynamic date universe with MS Sql as back end.
But when I try creating current year month dated class, it returns error :
Parse failed: Exception : DBD, [Microsoft SQL Server Native Client 10.0] : Incorrect syntax near 'From'.State:42000
I tested the universe connection which is working fine as evident from below screenshot :
BusinessObjects Configuration
Version 3.2.1.80
Build 14.1.1.1036
Network Layer OLE DB
DBMS Engine MS SQL Server 2008
Language en
Charset CP1252
Library D:\Programs\BusinessObjects4\SAP BusinessObjects Enterprise XI 4.0\dataAccess\connectionServer\drivers\lib32\dbd_wsqloledb.dll
SBO D:\Programs\BusinessObjects4\SAP BusinessObjects Enterprise XI 4.0\dataAccess\connectionServer\oledb\sqlsrv.sbo
RSS D:\Programs\BusinessObjects4\SAP BusinessObjects Enterprise XI 4.0\dataAccess\connectionServer\oledb\sqlsrv.rss
PRM D:\Programs\BusinessObjects4\SAP BusinessObjects Enterprise XI 4.0\dataAccess\connectionServer\oledb\sqlsrv.prm
Strategies Not Defined
Middleware and DBMS Configuration
Driver architecture 32
Charset UCS2
Driver name Microsoft SQL Server Native Client 10.0
Driver version 10.50.1600.1
Provider file name sqlncli10.dll
OLE DB Version 02.80
DBMS name Microsoft SQL Server
DBMS version 09.00.5069

Per SAP Note 1241422 - Database fragmentation and reindexing improves performance
Summary
Symptom
During the lifetime of a database (any db not only SAP Business One) and due to insert\update\delete of data, the information in indexes is fragmented. Fragmentation exists when indexes have pages in which the logical ordering, based on the key value, does not match the physical ordering inside the data file. Heavily fragmented indexes can cause slow performance.
Other terms
Index, performance, re-index, reindex, slow, poor, DB
Reason and Prerequisites
FAQ
Solution
It is recommended to run a rebuild the following procedure once\twice a month:

Can not extract data into BW from SQL SERVER

Dear All,
I meet a problem to extract data from database(MS SQL Server 2000(sp3)) into BW now and can not extract data into BW ODS, even PSA, In the monitor, display yellow light(0 from 0 record), detail message just display message "data request arranged" "confirmed with: confirmation" in requests(message) step; "missing message: request received" in extract (message) step; "no data" in processing(data packet) step and so on. but in fact, there are two records in my database test table and DB connection is OK. Even I can extract data from another test oracle database into BW ODS successfully.
Our BW system has two BW applicaton server and use oracle database. the one application server locates on IBM AIX host. the another one locates on one NT server. the application server on NT server is used for data extration from MS SQL SERVER database into BW oracle database. and MS SQL SERVER and NT platform application server locate on same one host. DBSL was installed on the NT application server already. and DB connector also was created successfully for MS SQL SERVER and datasource also was generated. DBSL type is Kernel640-WIN-IA32bit-unicode. my BW system is ECC5.0/UNICODE/ORACLE. all table/view/field name of MS SQL server is upcase and have not any specific character. for example: ZDEMO etc.
wait your help.
Thanks in advance.
Billy

Hi Ravi,
Could you help me to get knowledge about the followings:
approximately how many records extracting and transfering from SAP R/3 to BIW in an organisation. for that how much time will take .
How to extract data from two are three source system to BIW. Kindly help me with step by step explanation .If any screen shots with documents pls fwd to my ID. "[email protected]"
Your help highly appreciated.
Thanks.
Hema

Is it possible to save / extract data from a MS SQL database 2008 using lookout 6.2?

Is it possible to save / extract data from a MS SQL database 2008 using lookout 6.2?
Now a days we are saving / extracting data in a excel spreadsheet, but we would like to do that using a database because it is better.

You can use ODBC connection to work with SQL Server database.
Use SQLExec object to execute the SQL statement. Here is a KB about the SQL statement.
http://digital.ni.com/public.nsf/allkb/4ADEEA04CD24AE0B862565E20002A16F?OpenDocument
To write data to spreadsheet is more straightforward because Lookout has built-in spreadsheet object. But you need to write SQL statement by yourself to interact with other database.
To read the data back is the same way. Just use "select" SQL statement to query. You can use Datatable object to query.
The "Data Source" can be "DSN = data source name;". The data source name is configured in Control Panel->Administrative Tools->Data Sources(ODBC).
Ryan Shi
National Instruments

Data Services 4.0 installation with MS SQL 2008

hey guys,
I am trying to install data services 4.0 on a windows server with MS SQL database as the repository database. So, my plan was to install MS SQL 2008 first, then IPS, then data services. But i am facing a problem in installation of MS SQL itself. I installed MS SQL with following features - database engine, client tools and management tools. The installation process was smooth and the sql server services (server and agent) both startup just fine. I installed a custom instance for the same.
But problem is when I open the management studio and try to connect to the database engine, it does not connect, I choose database engine as the server type, local hostname as the server name and windows authentication as the authentican type but it fails with the following error:
TITLE: Connect to Server
Cannot connect to <myservername>.
ADDITIONAL INFORMATION:
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) (Microsoft SQL Server, Error: 53)
For help, click: http://go.microsoft.com/fwlink?ProdName=MicrosoftSQLServer&EvtSrc=MSSQLServer&EvtID=53&LinkId=20476
BUTTONS:
OK
Any clues as to what is causing this ??? Or is it normal at this stage of installation ?? I am confused. I have already tried to reinstall the server, no good, nothing in the event logs either.
Thanks,
RS

resolved via following:
In the TCP/IP Properties dialog box, on the IP Addresses tab, several IP addresses appear in the format IP1, IP2, up to IPAll. One of these is for the IP address of the loopback adapter, 127.0.0.1. Additional IP addresses appear for each IP Address on the computer. Right-click each address, and then click Properties to identify the IP address that you want to configure.
If the TCP Dynamic Ports dialog box contains 0, indicating the Database Engine is listening on dynamic ports, delete the 0.u201D
Once I deleted those zeros and put in 1433 for TCP ports on each IP address, voila!

MCTS 70-466 Implementing Data Models and Reports with Microsoft SQL Server 2012

I am searching for training kit for Exam 70-466 (Implementing Data Models and Reports with Microsoft SQL Server 2012) but I think is not published yet. I was expecting its release in Jan or Feb 2014. Would any one can tell me its release date or any place
where I can find this book.
Thanks

Hi Azhar lqbal Gondal,
According to your description, since the issue regards training and certification,
I suggest you post the question in the Learning forums at
http://social.technet.microsoft.com/Forums/en-US/home?category=learning. It is appropriate and more experts will assist you. If you have a specific technical question about Microsoft SQL Server,
you can visit and post your question on the SQL Server Forum.
There is some detail about Exam 70-466 Implementing Data Models and Reports with Microsoft SQL Server 2012, you can review the following articles.
Exam content can be found here:
http://www.microsoft.com/learning/en-us/exam-70-466.aspx
http://borntolearn.mslearn.net/certification/database/w/wiki/525.466-implementing-data-models-and-reports-with-microsoft-sql-server-2012.aspx#fbid=Mn-t6aRhs-H
Regards,
Sofiya Li
Sofiya Li
TechNet Community Support

SQL Loader - CSV Data file with carraige returns and line fields

Hi,
I have a CSV data file with occasional carraige returns and line feeds in between, which throws my SQL loader script off. Sql loader, takes the characters following the carraige return as a new record and gives me error. Is there a way I could handle carraige returns and linefeeds in SQL Loader.
Please help. Thank you for your time.
This is my Sql Loader script.
load data
infile 'D:\Documents and Settings\user1\My Documents\infile.csv' "str '\r\n'"
append
into table MYSCHEMA.TABLE1
fields terminated by ','
OPTIONALLY ENCLOSED BY '"'
trailing nullcols
( NAME CHAR(4000),
field2 FILLER,
field3 FILLER,
TEST DEPT CHAR(4000)
)

You can "regexp_replace" the columns for special characters

What component is included with Microsoft SQL Servers that can be used to perform a broad range of data migration tasks?

What component is included with Microsoft SQL Servers that can be used to perform a broad range of data migration tasks?
a. Full Text Search service
b. SQL Notification Server
c. SQL Reporting Server
d. SQL Server Integration Services

d.
Are you having a test and trying to cheat?
For every expert, there is an equal and opposite expert. - Becker's Law
My blog
My TechNet articles

SQL 2012 AlwaysOn Dual Data Centre (an instance in each data centre with a secondary in each other respectively)

Hi, hopefully someone will be able to find my scenario interesting enough to comment on!
We have two instances of SQL, for this example I will call them 'L' and 'J'. We also have two data-centres, for this example I will call them 'D1' and 'D2'. We are attempting to create a new solution and our hardware budget is rather large. The directive
from the company is that they want to be able to run either instance from either data centre. Preferably the primary for each will be seperated, so for example:
Instance 'L' will sit in data centre 'D1' with the ability to move to 'D2', and...
Instance 'J' will sit in data centre 'D2' with the ability to move to 'D1' on request.
My initial idea was to create a 6-node cluster - 3-nodes in each data centre. Let's name these D1-1, D1-2, D1-3 and D2-1, D2-2, D2-3 to signify which data centre they sit in.
'L' could then sit on (for example) D1-1, with the option to move to D1-2 (synchronously), D2-1,D2-2 (a-synchronously)
'J' could sit on D2-3, with D2-2 as a synchronous secondary and D1-3,D1-2 as the asynchronous secondaries.
Our asynchronous secondaries in this solution are our full DR options, our synchronous secondaries are our DR option without moving to another data centre site. The synchronous secondaries will be set up as automatic fail-over partners.
In theory, that may seen like a good approach. But when I took it to the proof of concept stage, we had issues with quorum...
Because there are three nodes at each side of the fence (3 in each data centre), then neither side has the 'majority' (the number of votes required to take control of the cluster). To get around this, we used WSFC with Node and File Share majority - with
the file share sitting in the D1 data centre. Now the D1 data centre has 4 votes in total, and D2 only has 3.
This is a great setup if one of our data centres was defined as the 'primary', but the business requirement is to have two primary data centres, with the ability to fail over to one another.
In the proof of concept, i tested the theory by building the example solution and dropping the connection which divides the two data centres. It caused the data centre with the file share to stay online (as it had the majority), but the other data centre
lost it's availability group listeners. SQL Server stayed online, just not via the AG listener's name - i.e. we could connect to them via their hostnames, rather than the shared 'virtual' name.
So I guess really I'm wondering, did anyone else have any experience of this type of setup? or any adjustments that can be made to the example solution, or the quorum settings in order to provide a nice outcome?

So if all nodes lost connectivity to the fileshare it means that there are a total number of 6 votes visible to each node now. Think of people holding up their hands and each one can see the hand. If the second link between the two sites went down then each
node on each side would only see 3 hands being held up. Since Quorum maximum votes =7, the majority needed to be seen by a node would be 4. So in that scenario, every node would realize it had lost majority and would offline from the cluster.
Remember that quorum maximum (and therefore majority), never changes *unless* YOU change node weight. Failures just mean then is one less vote that can be cast, but the required majority remains the same.
Thanks for the complement btw -very kind! I am presuming by your tag that you might be based in the UK. If so and you are ever nearby, make sure you drop by and say hello! I'll be talking at the
London SQL UG two weeks from today if you are around.
Regards,
Mark Broadbent.
Contact me through (twitter|blog|SQLCloud)
Please click "Propose As Answer" if a post solves your problem
or "Vote As Helpful" if a post has been useful to you
Come and see me at the
PASS Summit 2012

Data extraction with PL/SQL

Similar Messages

Maybe you are looking for