Sum of file sizes; based on file extension, sorted by size

Hello,
Here is what I need, hope someone can help me:
I want to get a sum of all file sizes in a current directory, based on the file extensions, e.g.
250K *.txt
800K *.php
2M *.jpg
10M *.mp4
I was trying something with "du -sch" and "type -f" but couldn't get a good result...
Thanks!

Still not quite there, but here is what I came up with using bits from here and there:
#!/bin/bash
ftypes=$(find . -type f | grep -E ".*\.[a-zA-Z0-9]*$" | sed -e 's/.*$\.[a-zA-Z0-9]*$$/\1/' | sort | uniq)
for ft in $ftypes
do
echo -n "$ft "
find . -name "*${ft}" -exec du -shc {} + | tail -1 | awk '{print $1}'
done
The output is:
.abc 3M
.bgh 150K
.cig 100M
.de 80K
but I can't the output as it as described in OP...

Similar Messages

Receive file content based on file Id/fileName

Hi,
I want to configure a scenario in XI that I can call via HTTP, pass the filename and receive the file conetnt of XML document.
Suppose I had created two structres, 1st is fileID, and 2nd is FileContent.
If i send the FileID/Filename, I should get File content based on FileId/Filename as output.
If I am doing HTTP to RFC, for BAPI-Company getdetail, I can fetch the data, based on the company ID, and can get company details as result,
I am doing Http to file, Now how shd i proceed with my case.
I send fileid/filename as input parameter, i shd get filecontent as output
Regards,
varun

Hi Varun,
i don't know how to do it in .Net
But procedure must be the same as that of java.
in java to develope web service we create a standalone EJB and expose it as a web service.
you will have a variable that will contain the path of the file.
then as return type take a variable of string type that will return the content of file.
Down load the WSDL of your webservice from WebserviceNevigator of your WAS,
Import it as a external defination in XI
Do the Required Mapping.
Thanks
Sunil Singh

How to pick the multiples based on file size

Hi All,
my sender file adapter needs to pick up 5 files based on file size.
for example 1file size is 500kb,2nd file size 300kb,3rd file size 400kb, 4file size 100kb and 5file size 600kb.
here my requirement is, my file adapter needs to pick in the below order like 5th file,1st file,3rd file 2nd file and 4th file.
means based on file size, i need to pick up my file adapter.
could you please ang inputs on this requirement.
Thanks & Regards,
AVR

Hi AVR,
for case 2:
1. At specific time each day "23:58:00" hours ,count the number of files in directory say "c:\apps\acm".
2. sort the files on basis of their size.
3. place the files one by one after definite time interval (more than polling time of the sender communication channel).
in target directory say "c:\apps\acm1" from where PI server picks up the files for further processing. The file with smallest size is placed last.
4. In this case you need to ensure all files are present in the directory "c:\apps\acm" before "23:58:00" hours.
for case 2 java code
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.util.Calendar;
import java.util.GregorianCalendar;
public class sortFilesOnSpecificTime {
* @param args
public static void main(String[] args) {
// TODO Auto-generated method stub
try
* In Unix/Linux OS, dir1="/usr/apps/test" etc
int pollingInterval=10,sleepTime=1*60;
String dir1="c:\\apps\\acm";
String dir2="c:\\apps\\acm1";
File fread=new File(dir1);
File fwrite=new File(dir2);
if(fread.canRead()==false)
System.out.println("error: "+dir1+" does not have read permission. Program Terminates.");
return;
if(fwrite.canWrite()==false)
System.out.println("error: "+dir2+" does not have write permission. Program Terminates.");
return;
String fileNames[],fileNamesOut[];
long fileSize[];
int i,j;
byte b[];
int t=4;
Calendar cal;
int hour24,min,fileCopyHour=23,fileCopyMin=58;
long waitSeconds=1,currentTime=0;
while(t>0)
cal = new GregorianCalendar();
hour24 = cal.get(Calendar.HOUR_OF_DAY); // 0..23
min = cal.get(Calendar.MINUTE); //0..59
System.out.println("current time="+hour24+":"+min);
/*loop unless time reaches a specific predetermined value
* predetermined values are provided by values
* fileCopyHour=8,fileCopyMin=30 i.e say 08:30 hours
currentTime=(hour24*60+min)*60;
waitSeconds=(fileCopyHour*60+fileCopyMin)*60 - currentTime;
if(waitSeconds>0)
* in case you wanna to make this thread sleep for
* say sleepTime(10) minutes before it checks the files once again
* because looping continuously causes wastage of CPU cycles.
Thread.sleep(waitSeconds*1000);
//read list of files
fileNames=fread.list();
if(fileNames.length;=0)
* time is up but there are no file
* in dir1 to copy. Then this program
* goes to sleep for some time and
* checks only at 11:55 hours. That is
* end of the day
continue;
fileSize=new long[fileNames.length];
fileNamesOut=new String[fileNames.length];
//read their sizes
for(i=0;i<fileNames.length;++i)
fileNamesOut=fileNames;
fileNames=dir1+System.getProperty("file.separator";)+fileNames;
fileSize=new File(fileNames).length();
System.out.println(fileNames+" size="+fileSize);
//sorting on basis of file size descending order
long value;
String temp;
for(i=1;i<fileSize.length;++i)
value=fileSize;
temp=fileNames;
for(j=i-1;j>=0 && fileSize[j]<value;--j)
fileSize[j+1]=fileSize[j];
fileNames[j+1]=fileNames[j];
fileSize[j+1]=value;
fileNames[j+1]=temp;
//now copy files to dir2
b=new byte[512];
for(i=0;i<fileNames.length;++i)
System.out.println(fileNames+" size="+fileSize);
for(i=0;i<fileNames.length;++i)
File f=new File(fileNames);
FileInputStream in=new FileInputStream(f);
FileOutputStream out=new FileOutputStream(dir2+System.getProperty("file.separator";)+fileNamesOut);
int len=0;
while(2>1)
if((len=in.read(b))<0)
break;
out.write(b,0,len);
in.close();
//delete files after copying from dir1
f.delete();
out.close();
//put each file after polling interval is over
Thread.sleep(pollingInterval*1000);
catch(Exception e)
e.printStackTrace();
The code runs in infinite loop. You need to run them in command line in DOS environment as you indicated that you OS is WIN XP. I have a few print statements which I kept for debugging, you can safely remove them and run the codes. This code is independent of the Operating System you are using. Only change is required in values of "dir1","dir2", timings and file count, which I think you can take care easily.
Hope this solves your problem.
regards
Anupam

IPhoto library too big -- how do I sort video, size to remove/archive?

Okay folks. So my iphoto library has gotten so big, I can't even install updates on my MacBook. Normally with any files on my computer, I can sort by size...see who's hogging up space and what I don't need. Not only can I not sort by size, I really have no way of managing these files in finder.
Advice?
Saw previous posts about "no sort by size". Someone even said "iPhoto is a photo manager, not a file manager" -- cute, but at some point the space runs out.

I really have no way of managing these files in finder.
It is strongly recommended that you do not use the finder to delete, move or otherwise modify any files within the iPhoto library - doing so risks corrupting your library and losing data
If you want to delete anything in the iPhoto library you must us the iPhoto program to do it
To identify your movies you can make a smart album for all items with the keyword = movie - selecting one and looking in the information window at the lower left hand corner will show you its size
LN

Group the files based on their extensions

Hi,
I am traversing a dir and listing all the files under that directory. Now i want to group the files based on the extension and just print the number of files with each extension.
ex:
Extension No.of Files Size of the files
.java 10 23455 bytes
.html 2 1000 bytes
I am able to get the extension of the files. I would like to know how to proceed after that.
Any sample code will be helpful.
Regards
Kutty

I have used a method to list all the files in the directory. After adding files with same extension to the HashMap. i am printing files after reading file by file. I need to print the files once i complete reading all the files in the directory.
Any suggestions?
private void listingFiles(File f )
 Map extensionMap = null;
 File[] files = f.listFiles();
 for( int i = 0; i < files.length; i++ )
 File file1 = files;
 Dprop.size += files[i].length();
 if (file1.isFile())
 fcount = fcount +1;
 if (extensionMap == null)
 extensionMap = new HashMap();
 // Group files by extension
 for(int idx = 0; idx < files.length; idx++)
 if (files[idx].isFile() && files[idx] != null)
 String ext = getExtension(files[idx]); // get the extension
 ext = ext.toLowerCase();
 List fileList = (List)extensionMap.get(ext);
 if(fileList == null)
 fileList = new ArrayList();
 extensionMap.put(ext, fileList);
 fileList.add(files[idx]);
 // Access all the files by extension
 for(Iterator extensionIterator = extensionMap.keySet().iterator(); extensionIterator.hasNext(); )
 String ext = (String)extensionIterator.next();
 List fileList = (List)extensionMap.get(ext);
 System.out.println("\n\nNo of Files "+fileList.size()+" with extension '"+ext+"' in '"+f+ "' Directory");
 for(Iterator fileIterator = fileList.iterator(); fileIterator.hasNext(); )
 File file = (File)fileIterator.next();
 System.out.println("File Name "+file+" File Size "+file.length());
 else
 dcount = dcount +1;
 listingFiles( file1 );
Thanks in advance
Kutty

How can I auto export a PDF File using the "Smallest File Size" preset and set the Exported File Name based on information from an Imported PDF?

Greetings all,
I am trying to create a script to automate a PDF export process for my company for inDesign. I’m fairly new to inDesign itself and have no previous experience with javascript, although I did take C++ in high school and have found it helpful in putting this code together.
We have an inDesign template file and then use the Multi-page PDF importer script to import PDF files. We then have to export two version of each file that we import, then delete the imported file and all of the pages to reset the template. This has to be done for nearly 1000 pdf files each month and is quite tedious. I’m working on automating the process as much as possible. I’ve managed to piece together code that will cleanup the file much quicker and am now trying to automate the PDF exports themselves.
The files are sent to us as “TRUGLY#####_Client” and need to be exported as “POP#####_Client_Date-Range_North/South.pdf”
For example, TRUGLY12345_Client needs to be exported as POP12345_Client_Mar01-Mar31_North and POP12345_Client_Mar01-Mar31_South.
There are two templates built into the template file for the north and south file that are toggled easily via layer visibility switches. I need to get a code that can ideally read the #s from the imported Trugly file as well as the Client and input those into variables to use when exporting. The date range is found in the same place in the top right of each pdf file. I am not sure if this can be read somehow or if it will have to be input manually. I can put North or South into the file name based on which template layer is visible.
I am not sure how to go about doing this. I did find the following code for exporting to PDF with preset but it requires me to select a preset and then type the full file name. How can I set it to automatically use the “Smallest File Size” preset without prompting me to choose and then automatically input some or preferably all of the file name automatically? (If the entire filename is possible then I don’t even want a prompt to appear so it will be fully automated!)
PDF Export Code (Originally from here: Simple PDF Export with Preset selection | IndiSnip [InDesign® Snippets]):
var myPresets = app.pdfExportPresets.everyItem().name;
myPresets.unshift("- Select Preset -");
var myWin = new Window('dialog', 'PDF Export Presets');
myWin.orientation = 'row';
with(myWin){
    myWin.sText = add('statictext', undefined, 'Select PDF Export preset:');
    myWin.myPDFExport = add('dropdownlist',undefined,undefined,{items:myPresets});
    myWin.myPDFExport.selection = 0;
    myWin.btnOK = add('button', undefined, 'OK');
myWin.center();
var myWindow = myWin.show();
if(myWindow == true && myWin.myPDFExport.selection.index != 0){
    var myPreset = app.pdfExportPresets.item(String(myWin.myPDFExport.selection));
    myFile = File(File.saveDialog("Save file with preset: " + myPreset.name,"PDF files: *.pdf"));
    if(myFile != null){
        app.activeDocument.exportFile(ExportFormat.PDF_TYPE, myFile, false, myPreset);
    }else{
        alert("No File selected");
}else{
    alert("No PDF Preset selected");
So far my code does the following:
1) Runs the Multi-Page PDF Import Script
2) Runs PDF Export Script Above
3) Toggles the Template
4) Runs #2 Again
5) Deletes the imported PDF and all pages and toggles template again.
It’s close and much better than the original process which was almost 100% manual but I’d like to remove the Preset prompt from the PDF script and have it automatically select the “Smallest File Size” preset. and then if there’s a way to have it auto-fill in the file name so no user input is required at all other than selecting each file to import. (If there’s a way to setup a batch action for the multi-import script that would be even better!)
Thanks in advance and if there’s anything else I can provide that would help please let me know! Even a nudge in the right direction will be a big help!

If you hold down the option key, it will typically show the location. Or you can often hit option-return on the file and it will reveal the file in the Finder, instead of opening it.
Final option is to open it, and just option-click the filename in the toolbar of Preview and it should show you the location.
It's probably an attachment to an email you've received. If you have Mail set to cache emails and their attachments it'll be stashed in a subdirectory of ~/Library/Mail. Which is fine.

Filter/Redirect based on file extension and path

Posted this earlier on the NSAPI list, didn't get a response. Can some
one help?
Thanks
Immanuel
I am attempting to write a filter/redirector based on file extension
and
the path of the file - some thing like:
http:\\www.wombat.com\filetpye1\file1.abc
gets redirected to server http:\\foo.com\file1.abc
http:\\www.wombat.com\filetpye2\file2.xyz
gets redirected to server http:\\bar.com\file2.xyz
Can some one tell me
a. Is this possible using NSAPI and conf file changes
b. Pointer (and source if available) to implment this
Regards
Immanuel

You need to use Client tages and redirect and other SAFs. More info in :
http://docs.sun.com/source/817-1834-10/crobjsaf.html#wp18074
http://docs.sun.com/app/docs/doc/820-1643/abvaq?l=en&a=view&q=Client+tags

Open default application based on file extension

I'm developing a small AppleScript that opens URLs of format "myapp:http://domain.com/data/filename.ext"
where 'myapp' is actually the applescript registered to be launched using "CFBundleURLName"
I wonder how to launch/open the default application registered for ".ext" file extension.
I found how to determine the default application based on a Real file:
default application of (info for POSIX file "/path/filename.ext")
Is it possible to determine the app based only on extension (i.e. the file itself doesn't exists yet).
I found that there is a function "LSGetApplicationForInfo" (https://developer.apple.com/library/mac/documentation/Carbon/reference/LaunchSer vicesReference/Reference/reference.html)
but have no idea how it can be used in applescript.
Thanks

set f to choose file
tell application "System Events" to set finfo to the properties of (f as alias)
set fileID to type identifier of finfo
if fileID is "com.apple.iwork.pages.pages" then
          set ftype to "Pages"
else if fileID is "com.microsoft.word.doc" then
          set ftype to "MS Word"
else if fileID is "com.adobe.pdf" then
          set ftype to "Preview"
else
          set ftype to "Unknown"
end if
display dialog "App is " & ftype
To determine the file type, use:
set f to choose file
tell application "System Events" to set finfo to the properties of (f as alias)
set fileID to type identifier of finfo
display dialog fileID

File server resource manager. Block file types based on size

I have a site where our users appear to be saving some pretty huge TV quality video files (usually .MOV, and usually over 900MB in size) to our file storage server. The
concern I have is that such large files are going to fill up our server we will run out of space .
I don't want to blanket block smaller (less than 30MB) .MOV video files from being saved
to the drive, so would like to know if there's any feature in the File server resource manager that can block file type based on size.
If it's not possible, then could someone please suggest this as a future feature of FSRM as I'm sure there are plenty of companies out there who face the same problem as me.
thanks,
Mike Geileskey
Infrastructure manager, PIAS UK Limited

Hi,
We could not block file types based on size by using FSRM. As a workaround you could use disk quotas on NTFS Volumes which are tracked on a per-user.
To apply disk quotas to existing volume users, add new quota entries in the Quota Entries window. Please understand that it will take you some time to add all users into the list.
It will allow administrators to control the amount of data that each user can store on an NTFS file system volume.
For more detailed information about disk quotas on NTFS Volumes, you could refer to the article below:
File Systems
http://technet.microsoft.com/en-us/library/cc938945.aspx
Best Regards,
Mandy
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place.

Pick a file based upon its extension

Hi Experts,
I have a requirment. I have to pick a file based upon its extension, i.e., the file having a particular extension, should be picked up before fiiles having a diferent extension.
Is this possible using only the adapter configuration?
Thanks and Regards,
Sanjeev.

Hi Sanjeev ,
Have a look at following PDF .These will be helpful to create your Road map
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/4f61fddf-0601-0010-7ab5-fb749538f6ab
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/d458a870-0601-0010-caab-b99c79741964
/people/krishna.moorthyp/blog/2005/06/09/walkthrough-with-bpm
BPM Steps..
http://help.sap.com/saphelp_nw04/helpdata/en/62/dcef46dae42142911c8f14ca7a7c39/frameset.htm
/people/shabarish.vijayakumar/blog/2006/11/26/adapter-scheduling--hail-sp-19-
Reward points if it is useful
Thanks
Sunil Singh

How to configure file upload restriction by file extension or size?

Hi,
I have recently configured a 7.0 portal with the BI-JAVA component. A feature for the BW reports and IP iviews is that a user can add comment and even upload a file to a default BI repisotory. It is easy to restrict access to users by means of ACL, but i also want to avoid users from uploading anything apart from *.PDF. It would also be nice to restrict in file size (otherwise it is easy to just rename a file you are uploading). Is there someting available to implement this in the portal?
I have read some threads that state this is not possible by default and only by creating a custom repository service or just hacking the upload command. These threads seem rather old and i dont know if the presented solution is still valid. Does anybody know if SAP is to delever a solution for this? (perhaps in an enhancement pack?)

Hi,
    Is there someting available to implement this in the portal?
    No. You have to develop this functionality.
    Have you read this blog: Restricting The Size Of The File To Be Upload in CM Repository ?
    https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/3219
Patricio.

Using log4j.xml to limit the size of a file

Hello,
I'm using JBoss. On startup it writes to boot.log and server.log. I'd like to limit the size that server.log can reach. At the minute I'm using the following code:

 <appender name="FILE" class="org.jboss.logging.appender.RollingFileAppender">
 <errorHandler class="org.jboss.logging.util.OnlyOnceErrorHandler"/>
 <param name="File" value="${jboss.server.home.dir}/log/server.log"/>
 <param name="Append" value="false"/>
 <param name="MaxFileSize" value="3KB"/>
 <param name="MaxBackupIndex" value="1"/>
 <layout class="org.apache.log4j.PatternLayout">
 <param name="ConversionPattern" value="%d %-5p [%c] %m%n"/>
 </layout>
 </appender>However this causes far more information to be written to boot.log than usual and nothing to server.log.
Can anyone help me in where I'm going wrong?
Thanks very much,
Ger

Solved.
Thanks,
Ger
Tell me more...

Logging option on file adapter based JNDI

Hello,
While setting up a file adapter based JNDI, I notice under outbound connection, we have logging option where we have rotate logs based on size/time. Could someone please help me understand what does this refers to and how we can use that.
its under - Deployment -> File adapter -> Outbound connection -->"Select a JNDI created by you" -> Logging.
my JNDI, represent to a location where I am writing few specific log content in a text file. Can we handle(rotate) that based on this.
Pls advice.

Hi,
you need to create 40 channels if you have users
as dynamically you can only create:
File Name
Directory
File Type
File Encoding
Temporary Name Scheme for Target File Name
with FTP adapter
Regards,
michal
<a href="/people/michal.krawczyk2/blog/2005/06/28/xipi-faq-frequently-asked-questions">XI / PI FAQ - Frequently Asked Questions</a>

What is the maximum size the of files we can use for reading and writing

Hi
i have attached a vi which i use to read and write reports.
My system would run continuosly for more than 2 days, typically i expect a file size of 30MB per day. I keep on appending the data in the file.
The VI everytime opens the file appends it and closes.
Does this affect the performance as the file size increases?
What is the effective way to do it?
Is there any file size restriction in windows?
Attachments:
Read_or_Write_Current_Cycle's_Data.zip ‏27 KB

First: The performance by increasing file size depends from the file system (FAT32 or NTFS) you are using. NTFS will be better if the file size increases. Also the size of the partition will have an effect on this.
Second: The effective way will be not to close and reopen the file. Use "File I/O > Advanced File Functions > Flush File" to write the file to the system instead of File Close and File Open. Flush File will force the file system driver to write the file to disk and update the file information on disk. On NT based systems this will be done with a latency time of 4 seconds. This is even true if you close the file and the time cannot be changed.
Third: There are file restriction to the lenght which do not depend on Windows, they depend on
the file system. FAT32 can handle files until 4 GByte (2^32) and NTFS can handle 2^64 Bytes. Since LV is platform independent the LV file functions can handle only 4 GByte. The offset parameter in the file functions has a I32 data type.
Waldemar
Waldemar
Using 7.1.1, 8.5.1, 8.6.1, 2009 on XP and RT
Don't forget to give Kudos to good answers and/or questions

Max size of MoH file

We upgrading a CUCM platform from MCS 7800 server version 7 to a new VMware based CUCM version 9.1.1.20000.
My client had a fixed MoH source connected by USB ports of MCS 7800, this external sound system has about 500 Gb of classical music, and this equipment uses analog port for sound broadcasting and it does NOT support Ip multicasting.
My client requires that the new CUCM MUST use this classical music as sound source for MoH.
As its external sound equipment does not support Ip multicast, I am suggesting to take about 80-100 Mb of its classical music ( about 20 different songs) and upload to CUCM as MoH audio source, so I need to confirm:
a) What is the largest size supported by CUCM for MoH files?
b) Can we upload multiples files (about 100 Mb of files) to be used as ONE MoH audio source? or ...
c) Does CUCM support only ONE file per MoH audio source.??
d) What format does CUCM support for this kind of audio source file?
I hope any of you can help with provided information.
Best Regards
Enrique Villasana

a) theorical limit, is how much HDD space you have left, never heard of someone uploading a 500 MB MOH file
b) no, then you will have as many audio sources as MOH files you upload
c) correct
d) this has been asked plenty, plenty of times before, a search on CSC could have provided this answer
Music On Hold audio sources
When the administrator imports an audio source file, the Cisco Unified Communications Manager Administration interface processes the file and converts the file to the proper format(s) for use by the music on hold server.
The recommended format for audio source files includes the following specifications:
16-bit PCM wav file
Stereo or mono
Sample rates of 48 kHz, 32 kHz, 16 kHz, or 8 kHz
http://www.cisco.com/en/US/docs/voice_ip_comm/cucm/admin/9_1_1/ccmfeat/CUCM_BK_C3E0EFA0_00_cucm-features-services-guide-91_chapter_0101010.html
I'd suggest using a router and multicast MOH using your external audio source if they want to keep all their music.
HTH
java
if this helps, please rate
www.cisco.com/go/pdihelpdesk

Sum of file sizes; based on file extension, sorted by size

Similar Messages

Maybe you are looking for