File to file but with append

Hi experts,
I have the following requirement :
we will receive 5 files on a distant ftp server. We need to transfer these 5 files on PI ftp server but the requirement is to concat these 5 files in 1 before they arrive on the PI ftp server and they apply mapping on the final file.
Is it possible during transfer of the 5 files on PI ftp server to make an append or something so that we have 1 file in final ?
Thanks a lot in advance for your help.
Kindly yours,
Jamal

HI ,
Firstly you want to achieve your requirement before it reaches to PI FTP Server so not possible using PI.
Yes, you can achieve it at FTP source server by running a Batchfile written in Unix or Shell script or Windows commands ( depende on server) . This Batch file can be scheduled at particular interval at source FTP server to append 5 files into one file at regular interval.
If you want to achieve the same after they reach to PI server. You can do above on PI server as well but does not involve PI technology at all.
I hope it helps to guide you further.
REgards,
Anurag Garg

Similar Messages

Saving a file in Vi creates same file but with ~ added [SOLVED]

Hi,
I'm not sure if I pressed a key combination, but when I save a file in Vi I get another file that has the same name as the original file but with the ~ character added to the end of the filename. For example, if I edit foo.txt and save it, then the original will be saved, but I'll also get a new file named foo.txt~. Does anyone know how to fix this?
Thanks!
-nterpol
Last edited by nterpol (2008-11-09 12:30:59)

I think that the default backup settings (in /etc/virc if you use the basic vi package) changed with the recent upgrade to Vim 7.2.25.
For information on file backup setting combinations, see :help backup-table in Vim.
Edit:
fwojciec wrote:http://thehumblecoder.wordpress.com/200 … kup-files/
That article advocates disabling the use of swap files (:set noswapfile); however, I wouldn't recommend it. Whereas backup files are designated with a trailing tilde (~), swap files have names ending with .swp. The latter should be removed automatically when Vim exits (unless it is exited abnormally, such as when the user closes a terminal emulator without first quitting an instance of Vim that is running inside it).
Last edited by ssjlegendx (2008-11-10 04:13:24)

Photoshop cs4 makes huge files - but with Aperture Whats the biggest file ?

When editing w/Photoshop cs4 by adding layers and masks etc, This makes HUGE files - but with using Aperture alone, what's the biggest file size when editing a RAW file?? (??? _Kb ??? __ mgB ????)
I think I heard -12kb. True ?_________ From what little I understand. Aperture changes the pixels once you have finished the editing. Or to put it another away, Aperture replaces the old or original pixels with the edited final pixels you prefer. IE -lighter darker. and with that said. is this still a RAW IMAGE?

Hello, and welcome to the Discussions.
It would seem that none of what you report hearing is accurate. A RAW file downloaded into Aperture, remains as the Master for this image, and is never changed -- that is why Aperture is said to utilize non-destructive editing. When editing in Aperture, only a small file of edit detail is saved, and no actual new version needs to be created until you Export for some purpose.
When you send an image file from Aperture to Photoshop to be edited, it typically will be a version created as a TIFF file, although there are 4 choices in the Preferences -- TIFF, TIFF 16-bit, PSD, and PSD 16-bit. When finished editing, the image is Saved in PS, that file is available to Aperture, and the version created for sending to PS will change to reflect those changes made in PS.
Aperture cannot send an edited RAW file to PS in this fashion, but you can Export the RAW Master, to later be opened in Photoshop.
You should watch all the available online tutorials about Aperture, and possibly buy a book as well.
Aperture may have trouble with super-sized images, but I have not had trouble with those in the range of 100 MB or less. Larger ones than that would likely be from scans and not from editing an image shot with your camera in Photoshop.
Ernie

Can I copy files – but with certain restrictions?

I have just finished a large project, the archives of which involves about 5000 "base" files, stored on about 80 CDs and 50 DVDs, involving about 50,000 files in total. Each of the "base" files may have had up to 30 incremental versions. i.e. a certain text file may have undergone revision 23 times, and each revision was saved and archived to (probably) a different disk, with a different suffix – a, b, c and so on. But sometimes the suffix didn't change even though the file was edited. I might have done a bit more dust removal on an image and just overwrote the old file (already archived), and so the new one was archived on a different disk.
I now have 130 disks from which I would like to extract all the files and collapse them to one large archive that will probably span about 20 disks by the time I delete some files not needed. That way I can easily search for all versions of, say, GB097, by going to the particular DVD that has the "G" files on it. Up would come:
GB097
GB097a
GB097b
GB097b-1
GB097b-2
GB097c
... and so on.
This is what I would like to do:
1. Grab the first archive disk, open every folder, and copy all the files to the one folder on a hard drive.
2. Open the second disk and repeat step (1), but with these two provisos.
(a) If a file is identical to a previously copied file (maybe I archived it twice), the file isn't copied. However...
(b) If a file has the same name as a previously copied file, but the data within that file is different (i.e. I removed some dust from an image file, but left the name unchanged), I'd like that file to be copied with a numbered suffix, the same way that Trash treats identically named files.
Any suggestions how I could do this?

Back again. This is the Terminal output when run on my +Duplicates Copy+ folder:
Last login: Thu May 20 13:28:30 on ttyp1
Welcome to Darwin!
jenny-pearces-imac-g5:~ Jenny$ chmod +x /Users/Jenny/Desktop/Bash\ Test\ Documents/BashTest.txt
jenny-pearces-imac-g5:~ Jenny$ /Users/Jenny/Desktop/Bash\ Test\ Documents/BashTest.txt /Users/Jenny/Desktop/Duplicates\ copy/
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 1: ${filePaths${count}}: bad substitution
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 17: fileSum0=d41d8cd98f00b204e9800998ecf8427e: command not found
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 1: ${filePaths${count}}: bad substitution
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 17: fileSum1=d41d8cd98f00b204e9800998ecf8427e: command not found
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 1: ${filePaths${count}}: bad substitution
/Users/Jenny/Desktop/Bash Test Documents/BashTest.txt: line 17: fileSum2=d41d8cd98f00b204e9800998ecf8427e: command not found
jenny-pearces-imac-g5:~ Jenny$
I'm not sure it's worth spending much more time on this. However, if you're prepared to keep posting, JJJ, I'll keep testing.
*SCRIPT AFTER THE EDIT*
#!/bin/bash
declare -i count=0
declare -a fileSum filePaths
# Main folder can be declared on the command line or if not then use /testpix
MainFolder="${1:-/testpix}"
# Set the internal field separator to newline to preserve spaces in file paths
IFS=$'\n'
# Use 'find' to create a list of files within the folders.
filePaths=( $( find "${MainFolder}" -type f \! -name ".*" ) )
# Get an MD5 checksum for each file's combined content of both data and resource forks
for file in ${filePaths[*]} ; do
fileSum${count}=$( cat "${filePaths${count}}" "${filePaths${count}}/rsrc" | md5 | cut -d'=' -f 2)
let count+=1
done
# For each file, check for a duplicate checksum and if found, move the matching file to the user's trash folder
# Rename files with duplicate names by appending #XX
for ((i=0;i<${count};i++)) ; do
[ -z "${filePaths[${i}]}" ] && continue
dupecount=1
for ((j=0;j<${count};j++)) ; do
[ -z "${filePaths[${j}]}" ] && continue
if [ "${fileSum[${i}]}" = "${fileSum[${j}]}" -a ${i} -ne ${j} ] ; then
mv "${filePaths[${j}]}" ~/.Trash && filePaths[${j}]='' && fileSum[${j}]=''
elif [ $(basename "${filePaths[${i}]}") = $(basename "${filePaths[${j}]}") -a ${i} -ne ${j} ] ; then
let dupecount+=1
dirname=$(dirname "${filePaths[${j}]}")
fullfilename=$(basename "${filePaths[${i}]}")
extension="${fullfilename##*.}"
filename="${fullfilename%.*}"
until [ ! -e "${dirname}/${filename} #${dupecount}.${extension}" ] ; do
let dupecount+=1
done
mv "${filePaths[${j}]}" "${dirname}/${filename} #${dupecount}.${extension}"
filePaths[${j}]="${dirname}/${filename} #${dupecount}.${extension}"
fi
done
done
exit 0

Multiple users using same files, but with different libraries

My wife and I both have our own iPhone 3Gs. We also have separate user accounts on our MacBook Pro. We would like to share the music/video files that we've got stored on a network drive, but we don't want to have the same library file. We both have different tastes in music, so I'd prefer if our song ratings were separate, as well as the rest of the library info (namely "last played date"). Is there a way that we can keep separate library files, but also be able to have new song purchases on one library automatically added to the other?

FryeX wrote:
I have this in my controller:
-(IBAction) setSize:(id)sender
And it would be enough to get to the title of the button
The sender param should be a pointer to the originating button, and you can use the button's tag property to id it. E.g.:
-(IBAction) setSize:(id)sender {
UIButton *button = sender;
NSString *title = button.currentTitle;
int tag = button.tag;
NSLog(@"sender=%@, title=%@, tag=%d", sender, title, tag);
- Ray

IMovie imports mp4 files but with distortion

Haven't posted on here before but can't figure this one out.
I have a Sony Handycam that records in mpeg2 format only.
I used MPEG Streamclip (video converter) to convert the mpeg2(.mpg) files to mpeg4 (.mp4)
format. I have no problem importing them in iMovie and they appear to have
some strange distortion that looks like horizontal lines going through everything.
I don't see this when I play the same converted file back in QuickTime.
I already spent the $20 to get the mpeg2 codec from Apple, which irritated me and
now I can't even work with the format I want.
What should I do? Is this something that just isn't going to happen?

Use MPEG Streamclip to convert your MPEG file to Apple Intermediate Codec for editing. After editing in iMovie, you can render in h.264.

Kill session through batch file but with DELAY/SLEEP

respected forum members,
i have a database 9i release 2 on windows server 2003.
as we r working in a territory where load shedding (electricity failure) is big problem intervaly. as users r working so there computer shutdown while they are working when there is power failure.
about 250 sessions are opened in peak hours and i want to kill these sessions.
so i want to write a batch file which kill session but at the same time I WANT TO PUT DELAY IN THE BATCH FILE which delay for 2 seconds after killing 20 sessions.
can any body help me to write such a batch file which delays for 2 seconds after killing 20 sessions. HOW to insert DELAY/SLEEP in batch file.
thanks

I'm not sure I understand the point of this script. If the power fails and the server goes down, obviously all sessions will be killed. If the power fails and the client goes down leaving database sessions, you would generally want to enable dead connection detection or limit the idle time of a session in the profile so that Oracle can automatically kill those sessions. Manually killing sessions should be a last resort.
If you really want to write this sort of script, could the batch file simply call DBMS_LOCK.SLEEP to implement the delay? Or do you literally mean that you only want the delay to come from an operating system call?
Justin

Same source file name with a different extension

Hi All,
I have a source file which is dynamic all the time. Can I create a target file which has the same name as the source file but with a different extension.
Scenaio is file to file.
test. xml is the source file name and the target file name should be as test.csv
Regards,
Amar

Hi Amareshwar,
you can write a java code (either in UDF or import in imported archive and use in imterface mapping).
The piece of code is..
DynamicConfiguration conf = (DynamicConfiguration) myParam.get(StreamTransformationConstants.DYNAMIC_CONFIGURATION);
DynamicConfigurationKey Filekey = DynamicConfigurationKey.create("http://sap.com/xi/XI/System/File","FileName");
String OriginalFileName = conf.get(Filekey);
if (OriginalFileName != null)
NewFileName=OriginalFileName.replaceAll(".csv",".txt");
conf.put(Filekey,NewFileName);
And in Integration Directory>Configuration Scenario>your communication channels (both sender and receiver) just select
Adapter specific message attributes- File name
This would solve your problem.....
Regards,
Vishal Gupta
Plz reward points if you are satisfied with the solution.

Can you export a raw file photo with Lightroom adjustments attached?

Can you export a raw file photo from Lightroom with Lightroom adjustments attached in some way? If not what is the equivalent? There are some individuals I would like to send the full data of the raw file, but with the non-destructive Lightroom adjustments layered on top.
--Gerry

You can select "Original" as the file type, in Export. This saves out a copy of the imported source file into the selected location, labelling the current adjustments onto that image. When this is sent to somebody and imported to LR / opened in ACR, these metadata will be found and used automatically, with the exact same outcome as within your own LR Catalog - provided the LR / ACR versions are sufficiently compatible, and provided camera and lens profiles applied to the image, are present in both contexts.
LR uses whatever method is normal when writing metadata, for each file type involved. So, if one imported file is a proprietary Raw file, LR will write an XMP file alongside. If another is capable of having metadata written into its file header, LR will do that instead.
One important difference between doing this, vs writing LR metadata out to your original imported file, and sending that: the Export Original method will work in the same way, just as successfully, for one or more Virtual Copy versions (duplicating physically as needed), as it will for the primary Master version - relating to a given imported file.

Have file name with date working but appending the time to file name can't get a result

DECLARE @dt AS VARCHAR(26)
SELECT @dt = REPLACE(CONVERT(VARCHAR(26),getDate(),110),'-','-'
Have this appended to a filename like: log_01-15-2015. Don't know what to add to SQL code to get the get the time and append time in hours, min, sec. like: log_01-15-2015_10:01:33
DECLARE @dt AS VARCHAR(50)
SELECT @dt = REPLACE(CONVERT(VARCHAR,CURRENT_TIMESTAMP,110),'-','-') +'_'+ CONVERT(VARCHAR,CURRENT_TIMESTAMP,108)
EXEC master.dbo.sp_configure 'show advanced options',1
RECONFIGURE WITH OVERRIDE
EXEC master.dbo.sp_configure 'xp_cmdshell',1
RECONFIGURE WITH OVERRIDE
SET @bcpCommand = 'bcp "SELECT * FROM ##Temp ORDER BY barcode" queryout "C:\TEMP\Log\ContainerHistory_Log_' + @dt +'" -c -T'
EXEC master..xp_cmdshell @bcpCommand
I am trying to append to the file created with the date a time stamp but when appending the time part for the filename results aren't creating the file. If it's just doing the date part then it is working. Any idea what is wrong?

Since you added ":" to the file name, the file name is not valid. You can change ":" to "-".
DECLARE @dt AS VARCHAR(50)
SELECT @dt = CONVERT(VARCHAR,CURRENT_TIMESTAMP,110) +'_'+ REPLACE(CONVERT(VARCHAR,CURRENT_TIMESTAMP,108), ':', '-')
SELECT @dt
A Fan of SSIS, SSRS and SSAS

Problem with Append mode in File Receiver

Hello,
I am facing some problem with Append Mode in File Receiver.
In channel config, i have given :
Construction Mode : Append
File Type : Text
Message Protocol : File Content Conversion
The size of the file which i am trying to send is about 9.5MB.
I got this error,
"Recovering from loss of connection to database; message
loaded into queue by recover job: System Job (Failover Recovery)".
So, it would seem that there was a loss of connnection to the database
while the file was being written.
Note - XI successfully recovered from the connection loss and
successfully wrote the file, however since the communication channel
was set to append, it appended to the partial file that was written
before the database connection loss. This is not correct. The file
should have been overwritten after the recovery even though the communication
channel was configured to append.
Can anyone help me on this regard.
Thanks,
Soorya.

Hi Venkat,
I would suggest u to split the file in to chunks if u face any problem in processing at a time in append mode and also
Memory Requirements are must 4 processing huge files:
Q: Which memory requirements does the File Adapter have? Is there a restriction on the maximum file size it can process?
A: The maximum file size that can be processed by the File Adapter depends on a number of factors:
o The most important one is the size of the Java heap, which is shared among all messages processed at a certain point in time. In order to be able to process larger messages without an out of memory error (OOM), it is recommended to increase the size of the available Java heap and/or to reduce the concurrency in the system so that fewer messages are processed in parallel.
o Another factor negatively influencing the maximum message size in releases up to and including XI 3.0 SP 13 is an enabled charcter set (encoding) conversion if the message type is set to "Text".
o Using the transport protocol "File Transfer Protocol (FTP)" also uses more memory for processing than the transport protocol "File System (NFS)" (up to and including XI 3.0 SP 13).
o If the Message Protocol "File Content Conversion" is used in a File Sender channel, consider that not only the size of the input file affects the File Adapter's memory usage, but even more the size of the XML resulting from the conversion, which is usually a few factors larger than the original plain text file.
To reduce the memory consumption in this scenario, consider configuring the setting "Maximum Recordsets per Message" for the sender channel. This will cause the input file to be split into multiple smaller mesages.
Plz do refer the following links:
U may plan the availability of ur communication channel using "Planning Availability Times" feature
http://help.sap.com/saphelp_nw04/helpdata/en/45/06bd029da31122e10000000a11466f/frameset.htm
/people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi
hi check the below links for reference
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/10748ef7-b2f0-2910-7cb8-c81e7f284af5
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/7086f109-aaa7-2a10-0cb5-f69bd2affd2b
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/2498bf90-0201-0010-4884-83568752a857
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/cc1ec146-0a01-0010-90a9-b1df1d2f346f
Regards,
Vinod.

File name for append processing mode with time stamp

Hi Experts
we are doing file to file scenario using the processing mode as Append.
the requirement for us to append the files and we need to have new file name with time stamp added to the appended file.but in the processing mode of the file adapter either we can append or add time stamp. thatz the problem I am facing now.
we are doing file based processing not message based ,micheal blog regarding the dynamic file name is for message based not for file based.
Please provide your valuable comments.
Thanks
Faheem

Hi mohamed,
I suggest you to map the target source structure to the required filename u want, like for example ur filename is input26062008.txt means to the target structure u perform the following mapping
constant (input) concat with currentdate function --> concat with constant .txt --> map this concat to target. So u will get the filename u expected with the time.
Then in the communication channel u select the mode as append. Now ur requirement will get solve i think so. plz try.
Regards,
Murugavel

To create multiple files with same content but with different names

Hi SapAll.
here i have got a tricky situation on Idoc to File Scenario.
in my interface of an Idoc to file ,there is requirement to create multiple files with different file names but with same content based on one Idoc Segment.
which means there will be one Zsegment with two fields in the idoc,where one field with (content refers to the name which file name should start with .so lets say if this segment is repeated for 3 times then PI should create 3 files in the same directory with same content but with different file names (from the filed).
so here for now iam using one reciever file communication channel.
can any body give me the quick answer.
regards.
Varma

What do you mean by different names?
when i make proper setting in the Receiver Channel....on how to create the filename (what to append) like add Timestamp, counter, date, messageid.....even in this case you will ahve file with different names and that too from same File channel.
You can perform multi-mapping in XI/ PI and then your File channel will place the files in the target folder with relevant names. You cannot use Dynamic Configuration with Multi-Mapping!
If you intend to use different File channels, then do the configuration as required (normal)...even over here you can follow multi-mapping.
Do not use a BPM!
Regards,
Abhishek.

When Photoshop CS6 is invoked from PSE 11 Organizer why is a new file created with _edited-1 appende

I just converted a large PSE 10 catalog to work with a downloaded trial version of PSE 11. When I brought up the Organizer and clicked on the Editor button I selected Photoshop CS 6. At that point the Organizer created an image stack with a new file on the top of the stack that had a file name that was the original file name with "_edited-1" appended to the end of it. Is there any way to avoid this? For me it is going to create a tedious step to delete the original file and rename the new file after editing. For probably 98% of my editing I will use only the Adobe Camera Raw editor on my imported raw files (Nikon's .nef). ACR puts the editing data in a sidecar .xmp file so there's no need to protect the original file from be mistakenly replaced by an edited version.

That's not a new behaviour : in old versions choosing the external editor did create a copy in a version set.
I don't have CS6, so I can't be specific, but I wonder why you should open CS6 if most of your images can be edited in ACR. For them, you only need to click 'Done' and that saves the edits in the xmp sidecar file. I guess most of the remaining files could be processed in the PSE11 editor and saved in any image format (jpeg, tiff, psd...). Only a minority would have to be processed in CS6***, and in that case, creating a new copy in a version set seems quite reasonable.
Edit:
*** in CS6 or the full ACR version of CS6. In my case, it's very rare that I need the other tabs in ACR.

Trying to drag pdf files i have and combine them into one pdf file in the account i just purchased with Adobe. when i drag a pdf file over Adobe doesn't accept it. says it can not convert this type of file. but it is an Adobe file. Do I need to change it?

Trying to drag pdf files i have and combine them into one pdf file in the account i just purchased with Adobe. when i drag a pdf file over Adobe doesn't accept it. says it can not convert this type of file. but it is an Adobe file. Do I need to change it in some other form befor dragging it?

Hello djensen1x,
Could you please let me know what version of Acrobat are you using.
Also, tell me your workflow of combining those PDF files?
Please share the screenshot of the error message that you get.
Hope to get your response.
Regards,
Anubha

File to file but with append

Similar Messages

Maybe you are looking for