Missing data in Output Mapping
Hi all,
I have configured a scenario RFC -> XI -> Webservice. I am getting the response from the webservice and can see it in the SXMB_MONI. But this is not getting mapped back to the RFC output. I checked for all the mappings and those are perfectly fine. Can any body please suggest me what could be the reason and what all i need to check. I have all the mappings and objects activated.
Thanks and best regards,
Kulwant
Hi sekhar,
Thanks for the quick reply.
I checked that anmd found that thers is one namespace missing in my mapping which is creating the problem
Here is what i get from Webservice
<?xml version="1.0" encoding="UTF-8" standalone="yes" ?> <ns1:generateResponse xmlns:ns1='http://xml.avaya.com/diamond/schema/2007/07/utils/sessionidgenerator' >
<ns1:sessionId>AAAAABDxRtA=7IWEUw==-_2_1</ns1:sessionId>
</ns1:generateResponse>
What i get from Test mapping
<ns0:generateResponse xmlns:ns0="http://xml.avaya.com/diamond/schema/2007/07/utils/sessionidgenerator">
<sessionId>dsfa</sessionId>
</ns0:generateResponse>
Here ns0 is missing in front of my mapping. I am not sure how to bring it.
I have created a data type generateResponse using another data type session ID.
then i created a message type with change in default XML name space. I tried creating even sessionID Message Type and use it in my message type so that i could change the default name space.
but it didn't worked?
Can any body please suggest what to do?
Thanks,
Kulwant
Similar Messages
-
Find the missing date from output data
Hi Guys,
For Ex,
I have the following ouput rows with column like
Id Name Mobile Signindate
1 AAA XXX 2012-03-01
2 AAA XXX 2012-03-02
3 AAA XXX 2012-03-05
4 AAA XXX 2012-03-06
5 AAA XXX 2012-03-07
the above rows will get based on startdate and enddate parameter like (mar 1,2012 ) to (mar 31,2012)
the Actual output needed is the missing date of Signin ,here in above ex ,it will be march 3 ,march4
Final Output is,
Id Name Mobile Signindate-Missed date
1 AAA XXX 2012-03-03
2 AAA XXX 2012-03-04
how to do in tsql
any help is needed
Thanks
r.bfinal output getting like this,
d ResourceID
ResourceName ReportsTo
Location eMail
Mobile Workdate
2013-12-01 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-07 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-08 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-11 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-12 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-13 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-14 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-15 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-16 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-17 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-18 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-19 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-20 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-21 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-22 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-25 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-26 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-27 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-28 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-29 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-30 NULL
NULL NULL
NULL NULL
NULL NULL
2013-12-31 NULL
NULL NULL
NULL NULL
NULL NULL
SELECT d.* ,a.*
FROM @Dates d
left join #tmp a on d.d =a.Workdate
WHERE d NOT in (SELECT Workdate
FROM #tmp)
suggestions needed, all fields coming as null except workdate ,workdate is the missing date
tnkx
r.b -
Data missing in PDF output generated by RDF locally only for one time.
Hi All,
Could any one please help me in finding the reason of the below mentioned issue.
I have downloaded an RDF onto local machine and changed only sorting of few columns required.
After that I had generated PDf output on local machine for first few times PDF is generated with correct output.
Unfortunately when I again generated PDF output as final version, a few columns are missed in displaying in the PDF output. again I ran the RDF for next time and the PDF is generated correctly.
Now I want to know what may be the reason that for that time only PDF generated with missing data.
FYI, Problem occured in Report Builder *9.0.4.0.33*
This reason is really urgent and needfull for me.
Your help is very much appreciated.
Many Thanks in Advance.
Regards,
RRMHello,
What is the report orientation PORTRAIT/LANDSCAPE? What happens if you set the SYSTEM PARAMETER ORIENTATION to PORTRAIT/LANDSCAPE upon your report output and then generate again. While saving as PDF also see the page orientation.
-Ammad -
Filter Idoc segment based on date in XSLT map
Hi,
In a Idoc to flat file XSLT mapping, I have a requirment to filter segment out of multiple segment occurance in HRMD_A idoc. Idoc has two date fields(actually string data, containing date in YYYYMMDD format) in the segment(end date and start date). I need to filter only one segment from multiple segments where current date falles within start and end dates (end date >= current date >= start date). Then map output fields from the filtered segment.
Its easy doing it in graphical mapping, but its difficult to use graphical mapping here as the message structure are enormous. I dont have much hands on in XSLT but think many of you have been through this kind of requirement using XSLT. So holding my hope high :). Please suggest a logic for this, will be highly appretiated.
Regards
Suman.This functions will give you the current date:
fn:current-dateTime() => Returns the current dateTime (with timezone)
fn:current-date() => Returns the current date (with timezone)
fn:current-time() => Returns the current time (with timezone)
To compare:
fn:compare(comp1,comp2)
fn:compare(comp1,comp2,collation)
=> Returns -1 if comp1 is less than comp2, 0 if comp1 is equal to comp2, or 1 if comp1 is greater than comp2 (according to the rules of the collation that is used)
Example: compare('ghi', 'ghi')
Result: 0
Also I suggest working with an IF condition like this:
<xsl:if test="price > 10">
<tr>
<td><xsl:value-of select="title"/></td>
<td><xsl:value-of select="artist"/></td>
</tr>
</xsl:if>
Edited by: Kai Lerch-Baier on Apr 14, 2009 10:21 AM -
How to validate a date in message mapping
Hi experts,
how to validate a date in message mapping. For ex: if date comes as 2008/02/31, then file it shold not get processed.how to achieve this in message mapping. Please help .
Thanks&Regards,
Reyaz HussainHi,
There are few simple ways for date validation as follow,
1.If you would like to handle it in XI only, then in message mapping you could verify about it with the help of generating smart exception.
For e.g in mapping there is one Date conversion API i.e. somthing DateTransformation It converts the incoming date format to required format. Here give the date format i.e expected from Sender File.
If in case the format miss-matched then it will create the exception.
You could handle this exception with the use of [Alert notification|http://help.sap.com/saphelp_nw04/helpdata/en/2c/abb2e7ff6311d194c000a0c93033f7/frameset.htm] and could be even able to notify to sender system about it.
2. The another solution is easy for SAP synchornous communication --If you are passing the file data to SAP, then you could use below function modules to verify date format in receiver RFC/BAPI or inbound IDOC program. If the sy-subrc is not 0 then don't process further.
CONVERT_DATE_FORMAT
ISU_DATE_FORMAT_CHECK
Thanks
Swarup -
Grouping to display null values for all the missing dates
Hi SAP,
I am trying to display '0.00' value for all the missing dates in my crystal reports as follows:
17-Jan-14 40.00
18-Jan-14 0.00
19-Jan-14 0.00
20-Jan-14 80.00
However, my crystal report is showing as follows:
17-Jan-14 40.00
18-Jan-14 0.00
19-Jan-14
20-Jan-14 80.00
The missing dates with no data are group together and my '0.00' value is not. Kindly advise me the solution. The formula is shown as per attached.
Thank you.
Regards.Hi,
Thanks for your reply.
Fyi, I am using a formula field in crystal report to display "0.00" for days in between as follows:
whileprintingrecords;
if Days_Between({Command.DocDate},next({Command.DocDate}),'dd-MMM-yy') = "" then "" else "0.00"
There is another formula field in crystal report to display the missing dates in between as follows:
whileprintingrecords;
Days_Between({Command.DocDate},next({Command.DocDate}),'dd-MMM-yy')
Below is my report custom functions:
Function Days_Between (datefield as datetime, nextdatefield as datetime, format as string)
' This function is only used to display what data is missing within a specified date range...output type is text
dim thisdate as date
dim nextdate as date
dim output as string 'output is the text display
dim daysbetween as number
dim looptimes as number
looptimes = 0
daysbetween = 0
output = ""
thisdate = datevalue(datefield) + 1
nextdate = datevalue(nextdatefield)
if nextdate - thisdate > 1 then daysbetween = nextdate - thisdate else daysbetween = 1
do
if nextdate - thisdate > 1 _
then output = output + totext(thisdate, format) + chr(10) _
else _
if nextdate - thisdate > 0 _
then output = output + totext(thisdate, format)
looptimes = looptimes + 1
thisdate = thisdate + 1
loop until looptimes = daysbetween
Days_Between = output
End Function
The issue arise when when there is more than one missing dates in between but the null values ("0.00") displayed is only for the first missing dates and not for all the missing dates.
Regards,
Ting Wei -
Selecting missing date range with previous records value
Hello,
SQL> select * from v$version;
BANNER
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
PL/SQL Release 11.2.0.1.0 - Production
CORE 11.2.0.1.0 Production
TNS for 32-bit Windows: Version 11.2.0.1.0 - Production
NLSRTL Version 11.2.0.1.0 - Production
SET DEFINE OFF;
create table t(NBR_OF_S number, NBR_OF_C number, S_DATE date);
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(34, 40, TO_DATE('05/01/2012 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(27, 29, TO_DATE('03/01/2012 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(21, 23, TO_DATE('12/01/2011 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(19, 20, TO_DATE('10/01/2011 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(18, 19, TO_DATE('09/01/2011 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(17, 17, TO_DATE('08/01/2011 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(16, 16, TO_DATE('06/01/2011 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(9, 9, TO_DATE('12/01/2010 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(5, 5, TO_DATE('11/01/2010 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
Insert into T
(NBR_OF_S, NBR_OF_C, S_DATE)
Values
(2, 2, TO_DATE('01/01/2010 00:00:00', 'MM/DD/YYYY HH24:MI:SS'));
COMMIT;
SQL> select * from t order by 3 desc;
NBR_OF_S NBR_OF_C S_DATE
34 40 01-MAY-12
27 29 01-MAR-12
21 23 01-DEC-11
19 20 01-OCT-11
18 19 01-SEP-11
17 17 01-AUG-11
16 16 01-JUN-11
9 9 01-DEC-10
5 5 01-NOV-10
2 2 01-JAN-10
10 rows selected.I want the output like as follows, all those missing date i need to carry on the last one's number
NBR_OF_S NBR_OF_C S_DATE
34 40 01-MAY-12
27 29 01-APR-12
27 29 01-MAR-12
21 23 01-FEB-12
21 23 01-JAN-12
21 23 01-DEC-11
19 20 01-NOV-11
19 20 01-OCT-11
18 19 01-SEP-11
17 17 01-AUG-11
16 16 01-JUL-11
16 16 01-JUN-11
9 9 01-MAY-11
9 9 01-APR-11
9 9 01-MAR-11
9 9 01-FEB-11
9 9 01-JAN-11
9 9 01-DEC-10
5 5 01-NOV-10
2 2 01-OCT-10
2 2 01-SEP-10
2 2 01-AUG-10
2 2 01-JUL-10
2 2 01-JUN-10
2 2 01-MAY-10
2 2 01-APR-10
2 2 01-MAR-10
2 2 01-FEB-10
2 2 01-JAN-10Any help would be greatly appreciate.
Note: The date value I have created for this sample is monthly, based on the condition the data value I may need to generate weekly also. That's Monthly or weekly either one
Thanks,And what is AMT? You didn't provide such column in your original post. Anyway, MODEL solution based on original post:
select nbr_of_s,
nbr_of_c,
s_date
from t
model
partition by(rowid)
dimension by(1 d)
measures(
nbr_of_s,
nbr_of_c,
s_date,
months_between(lag(s_date) over(order by s_date desc),s_date) cnt
rules(
nbr_of_s[for d from 1 to cnt[1] increment 1] = nbr_of_s[1],
nbr_of_c[for d from 1 to cnt[1] increment 1] = nbr_of_c[1],
s_date[for d from 1 to cnt[1] increment 1] = add_months(s_date[1],cv(d) - 1)
order by s_date desc
NBR_OF_S NBR_OF_C S_DATE
34 40 01-MAY-12
27 29 01-APR-12
27 29 01-MAR-12
21 23 01-FEB-12
21 23 01-JAN-12
21 23 01-DEC-11
19 20 01-NOV-11
19 20 01-OCT-11
NBR_OF_S NBR_OF_C S_DATE
18 19 01-SEP-11
17 17 01-AUG-11
16 16 01-JUL-11
16 16 01-JUN-11
9 9 01-MAY-11
9 9 01-APR-11
9 9 01-MAR-11
9 9 01-FEB-11
NBR_OF_S NBR_OF_C S_DATE
9 9 01-JAN-11
9 9 01-DEC-10
5 5 01-NOV-10
2 2 01-OCT-10
2 2 01-SEP-10
2 2 01-AUG-10
2 2 01-JUL-10
2 2 01-JUN-10
NBR_OF_S NBR_OF_C S_DATE
2 2 01-MAY-10
2 2 01-APR-10
2 2 01-MAR-10
2 2 01-FEB-10
2 2 01-JAN-10
29 rows selected.
SQL> SY.
Edited by: Solomon Yakobson on Jun 11, 2012 1:34 PM -
How we can view convert data after XSLT mapping & before Graphical mapp
Hello Friends,
Currently i am working on XI standard content. In this client need some customization.
In interface mapping, XSLT mapping on 1st position & Graphical mapping on 2nd position.
As per my understanding 1st XSLT mapping will be exected then Graphical mapping.
Can I see or check convert data from XSLT mapping.
I want to check data between XSLT mapping & Graphical mapping.
Kindly help me out.
Regards,
Narendra>
Narendra GSTIT wrote:
> I dont want to test standalone XSL Code.
>
> The data which I get from Source interface and after XSLT mapping I want to check this that my XSLT code is going well or not.
>
> i.e. check for proper input & get proper output.
You have ro do standalone testing of the XSLT mapping.....Interface Mapping or Interface Determination will give you output message which will be that of message mapping (the last mapping)
What is the issue in testing the XSLT mapping alone?...may be in Stylus Studio.
Just ensure that XSLT mapping produces proper output and then this output message of XSLT is the input to your Message Mapping.....once the entire Interface mapping gets executed then it would mean that all the included mapping programs work fine.
Regards,
Abhishek. -
Hello,
we created a planning area with storage time profile level days. For the statistical forecast, the input and output key figures are defined per month. We defined a statistical forecast profile with Single Exponential Smoothing as method as well as two values for alpha attached to this profile.
When executing the forecast, it stops with the following error message:
Using parameters: forecast model id = 10010, Input key figure = AGGRORDERENTRYQTY, Output key figure = STATFCSTQTYSINGEXPSM, Starting historical period = 11048, Ending historical period = 11411, Time horizon start = 10682, Time horizon end = 12142, Current period = 11412, Period offset = 0, Period attribute = PERIODID3, Past period offset = 0, Future periods to forecast = 365, Filter id = 0, Scenario = BASELINE, ESCAPENULL/Complete missing data = 1
We changed the time parameters of the forecasting profile and the planning area and tested different combinations, but the error repeats.
I would appreciate any idea how to solve this issue.
Cheers,
JonathanScot,
K is not needed...Ref to Stat Forecasting - Moving Average
Thanks,
Krishna -
ORA-19612: datafile 0 not restored due to missing data
Hello,
I'm testing a restore of the controlfile. The database is in archivelog mode and autobackup is set to ON. I successfully did a full backup and backup as copy database.
To test I did the following:
- note the DBID
- shutdown the database
- renamed both controlfiles:
$ mv /u02/rcat/control01.ctl /u02/rcat/control01.ctl_old
$ mv /u02/fra/rcat/control02.ctl /u02/fra/rcat/control02.ctl_old
When I try to restore the controlfile form autobackup I receive the following error. What could be reason please?
[rcat@oel54]$ rman target /
Recovery Manager: Release 11.2.0.1.0 - Production on Fri Dec 10 00:07:41 2010
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: RCAT (not mounted)
RMAN> set dbid 502889862;
executing command: SET DBID
RMAN> restore controlfile from autobackup;
Starting restore at 10-DEC-10
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=19 device type=DISK
recovery area destination: /u02/fra
database name (or database unique name) used for search: RCAT
channel ORA_DISK_1: AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp found in the recovery area
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101210
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101209
channel ORA_DISK_1: restoring control file from AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of restore command at 12/10/2010 00:09:55
ORA-19870: error while restoring backup piece /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
ORA-19612: datafile 0 not restored due to missing data
$ ll /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
-rw-r----- 1 oracle dba 10354688 Dec 9 23:44 /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkpThanks!The file was indeed corrupted as below will show.
Very strange. Perhaps something with the latest Virtualbox or the SSD/hybrid harddrive. (host MacOSX 10.6, guest Oracle Linux 5.5 UEK)
$ mv /u02/rcat/control01.ctl_old /u02/rcat/control01.ctl
$ mv /u02/fra/rcat/control02.ctl_old /u02/fra/rcat/control02.ctl
SQL> startup mount
ORACLE instance started.
SQL> recover database;
ORA-00283: recovery session canceled due to errors
ORA-00264: no recovery required
SQL> alter database open;
Database altered.
$ rman target /
connected to target database: RCAT (DBID=502889862)
RMAN> backup current controlfile;
piece handle=/u02/fra/RCAT/backupset/2010_12_10/o1_mf_ncnnf_TAG20101210T012420_6j2wsoko_.bkp
Finished backup at 10-DEC-10
Starting Control File and SPFILE Autobackup at 10-DEC-10
piece handle=/u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp comment=NONE
Finished Control File and SPFILE Autobackup at 10-DEC-10
RMAN> restore validate controlfile;
piece handle=/u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp tag=TAG20101210T012422
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: validation complete, elapsed time: 00:00:02
Finished restore at 10-DEC-10
SQL> shutdown immediate
$ mv /u02/rcat/control01.ctl /u02/rcat/control01.ctl_old
$ mv /u02/fra/rcat/control02.ctl /u02/fra/rcat/control02.ctl_old
SQL> startup nomount
$ rman target /
connected to target database: RCAT (not mounted)
RMAN> set dbid 502889862;
RMAN> restore controlfile from autobackup;
Starting restore at 10-DEC-10
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=19 device type=DISK
recovery area destination: /u02/fra
database name (or database unique name) used for search: RCAT
channel ORA_DISK_1: AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp found in the recovery area
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101210
channel ORA_DISK_1: restoring control file from AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp
channel ORA_DISK_1: control file restore from AUTOBACKUP complete
output file name=/u02/rcat/control01.ctl
output file name=/u02/fra/rcat/control02.ctl
Finished restore at 10-DEC-10 -
Word 2010 Mail Merge Missing Data
I have a large Excel data file:
1725 records, 31 columns, 1.74MB total size.
Other data:
Windows 7 (64 bit)
Word/Excel 2010 Version: 14.0.7116.5000 (32-bit)
I am running a standard mail merge on a filtered subset of the data (112 records). At least one of the merge fields is RANDOMLY missing from the merge document. This is clearly evident because this is a field that is populated for EVERY record. I don't believe
that I have every seen this behavior before.
Can someone please direct me to the cause of this or a work-around?There are numerous possible reasons. The most likely is that the column concerned has missed data types (e.g. numbers plus text and/or dates). Some explanation:
By default, Word (2002 & later) uses the OLE DB provider to get merge data from an Excel workbook. The basic problem with using the OLE DB provider is that it's designed to return data in a way that is compatible with Access and other relational database
packages. Access requires a specific data type for each field, and every value in that field must have only that data type. In Excel, however, cells in a column (field) can have different data types. When the OLE DB provider gets data from an Excel column
with mixed data types, it has to determine the data type for each column. The first 8 records are used for that (the 8 can be changed in the Windows Registry, but it’s not advisable to do so). Records that don’t conform to the determined data type are liable
to not be handled correctly. To complicate matters, for historical reasons, there are two text data types: "text" (up to 255 characters) and "memo" (can be longer than that).
Some common mailmerge issues arising out of this include:
• Numbers but not text or dates being output for some records; and
• Text data being truncated at 255 characters.
Ideally, one would ensure each field has only one data type. That way, the problem wouldn't arise.
Workarounds include:
• Inserting a dummy first record containing data in the format that is not being output correctly; or
• Reordering the data so the first record has content in the format that is not otherwise being output correctly.
Thus, if numbers appear but text and/or dates don’t, ensure the first record for that field has text or a date. Similarly, if text over 255 characters is being truncated, ensure the first record for that field contains more than 255 characters.
Cheers
Paul Edstein
[MS MVP - Word] -
SSIS 2005 and SSIS 2012 Have Different Data Flow Output
Hi Guys,
I'm currently converting our SSIS 2005 packages to 2012 and I'm finding an odd difference on the Data Flow Output when it imports a txt file to a table.
We have a pipe delimited file ( contains a totals on the bottom row).
CATNO|Title|Total Stk Avail|Stk on Order|Rank|QOH|Allocated|Reserved|BackOrd|WIP|Cleared|Held
CATNUM000067|Fast and Furious|9804|0||9804|0|0|0|0|0|0
CATNUM000068|Frozen|0|0||0|0|0|0|0|0|0
CATNUM000029|Brave|0|0||0|0|0|0|0|0|0
CATNUM000029|Brave with Kinect|0|0||0|0|0|0|0|0|0
CATNUM000029|Big Hero|0|0||0|0|0|0|0|0|0
CATNUM000057|Transformers|27376|0||27376|0|0|0|0|0|0
CATNUM000013|James Bond|121|0||121|0|0|0|0|0|0
,Total Available Stock,524259
And these are the settings for the flat file connection
In SSIS 2005, the total rows are being omitted automatically by the data flow. Basically only 7 rows are inserted whereas in SSIS 2012. 8 rows were inserted including the totals.
if we think about it, SSIS 2012 is correct since we just feed what's ever in the file.
But on the conversion and testing perspective, it's now harder as there's discrepancies between those 2 version.
I just like to check if there's any other discrepancies in terms on results/output between SSIS 2005 and SSIS 2012
Many thanks.Hi Vinxster,
After testing the issue that Flat File Connection Manager cannot handle file with total row in my SQL Server 2005 environment, I can reproduce it.
Based on my research, the issue is caused by the Column Delimiter gets first preference and then Row delimiter. This is by design in SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2.
Good news is that the issue is fixed in SQL Server Data Tools which comes with SQL Server 2012. In SQL Server 2012, by default, the Flat File Connection Manager always checks for a row delimiter in unquoted data, and starts a new row when a row delimiter
is found. This enables the connection manager to correctly parse files with rows that are missing column fields.
If you want to fix the issue in SQL Server 2005, there is a sample component posted to the CodePlex that might help you with this:
http://ssisdfs.codeplex.com/
References:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2013/03/13/flat-file-source-cannot-handle-file-with-uneven-number-of-columns-in-each-row.aspx
https://connect.microsoft.com/SQLServer/feedback/details/293193/ssis-import-of-flat-file-with-uneven-number-of-columns
Thanks,
Katherine Xiong
If you have any feedback on our support, please click
here.
Katherine Xiong
TechNet Community Support -
I have 4 asynchronous running VIs that share data between each other via queues. The producer VI puts the data on 2 different queues; one for a consumer VI to write data to a file and one for 2 consumer VIs to display data. The first display VI takes all the data (in waveform format) and converts it to a string for display in a table. The second display VI takes a subset of the data and converts it to DBL for display on individual indicators.
I am not experiencing any lost data being written to the data file. I am experiencing missing data for the displays. I put a test sine wave on one of the data channels to figure out which queue output is having the problem. There are about 90 channels of data being collected.
The table VI only displays the latest data point for each channel in the table. I didn't notice any missing data until I wired the test channel into a chart. I thought could be an update issue. However, ...
The subset VI displays all the data from the test channel in a chart and there is missing data. Out of all the channels only one is being displayed.
The producer VI puts the data on the queue using Lossy Enqueue Element function. The consumers get the data from the queue using the Preview Queue Element function.
Any ideas on where to begin to diagnosis the problem? I would post code but I haven't successfully posted any files to this forum. Is there any other location I could post?Bob_Schor wrote:
Can you point to an example, or provide one? This sounds like an Interesting Technique to Learn ...
I do this all the time. My prime example is with data that needs logged and updated to the GUI. So I have one loop that processes data and then sends it by generating a User Event. I then have a data logging loop that is registered for the event that can log the data. I will then have another loop that handles the GUI that is registered for the event to just update an indicator.
This example is a lot dumber than that (it just updates two indicators). Saved in 2014. Let me know if you need an older version.
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
Attachments:
User Event.zip 17 KB -
Find out missing dates in table
Hi,
I've a table that sould have a record for day with sales info, but for some reason there are missing dates, is there any way i could find out witch dates are missing.
Table Example:
sales_date | value
2010-01-01 | 20
2010-01-02 | 30
2010-01-04 | 40
The output of the query for the example above sould return only the missing date (2010-01-03).
Thanks in advanceHow about (I wouldn't use this if your concerned about speed!)...
WITH src_data
AS (SELECT TO_DATE('2010-01-01', 'YYYY-MM-DD') sales_date FROM DUAL
UNION ALL
SELECT TO_DATE('2010-01-02', 'YYYY-MM-DD') sales_date FROM DUAL
UNION ALL
SELECT TO_DATE('2010-01-04', 'YYYY-MM-DD') sales_date FROM DUAL),
date_table
AS (SELECT LEVEL, MAX(sales_date) - LEVEL + 1 my_date
FROM src_data
CONNECT BY LEVEL <=
(SELECT MAX(sales_date) - MIN(sales_date) + 1
FROM src_data)
GROUP BY LEVEL
ORDER BY my_date ASC)
SELECT *
FROM date_table
WHERE NOT EXISTS (SELECT 1
FROM src_data
WHERE sales_date = my_date)Cheers
Ben -
Treating empty cells as missing data in formulae in Numbers '09
I'm working with numerical data where many cells are empty (missing data). My problem is that when I use formula to make calculations, Numbers treats empty cells as zeros, and won't let me search and replace an empty cell with a placeholder (like . in excel).
Any ideas?When we don't want to display the result of a calculation on a certain condition, we can test for that condition and substitute a different output. In your case, you may have blank input cell and you don't want to display the negative result that would otherwise occur. There are at least two general approaches that you could use. The easiest would be to go ahead and make the calculation and then format all negative results to a font that wouldn't be visible, using Conditional Format. A slightly more complicated way, as Barry described above, would be to test for the blank cell condition and substitute a null string. Here's a graphic of the null string case.
When you have learned a few basic tricks this will all seem easy to you.
Jerry
Maybe you are looking for
-
Cannot download pictures from incoming email
This is happening when I use .mac webmail OR my email client at home. When I use webmail, I get a message that says: Unable to process your request. At home, it just tries and tries and nothing happens. I have also tried to forward the email with the
-
Manual Input of TAx Amount in Sales AR Invoice
Hi Experts! Is there a way where we can do a manual recording of tax amount in Sales AR Invoice (just like in AP Invoice, we can manually input tax amount)? Hope to hear from you soon, Thanks
-
Illustrator Freezing When Adding Second 3d Revolve
Hi, I've been using Illustrator for almost 48 hours now in an effort to make a 3d logo for my next website and everything has been going fine until I try to add a second 3d revolve effect to a globe containing letters. Whenever I do this Illustrator
-
Oracle 9i database (9.2.0.1.0) config Enquiry
Hi all, this is my first time installing oracle in my home PC coz i need to do forms and reports for my assignment but it seems that I can't get it working :( Hope that someone can give me some advice... 1. How do i config the oracle such as the tsn
-
When I print out an Illustrator file the color on the paper appears different then on Illustrator. Sometimes it might even be the same exact color, but it would print in two different shades of that color. How can I resolve? Any help would be greatly