How to make SSIS packages automatically read the input file from a path?

Question

Currently I am using a SSIS package to read data from a .dat file and load it into SQL Server tables.
I am placing the input .dat file on the desktop. In the connection manager -> Browse option, I am pointing this file to create connection.
The file naming convention is like - aSNAP_Data_20140926_P-2014-09-26_07.02.36
However, I need the SSIS package to automatically read the input file from a folder which is located in a remote server. This folder has lots of files where input files are added on a daily basis with the date value in the file name as mentioned above.
I want to schedule the SSIS package to run daily and take the latest file in the folder based on the date.
Please let me know how to do it. Any help would be highly appreciated.....
Thanks in advance.

Answer 1

Hi SQL_SSIS_Dev,
According to your description, you want to get the latest file from a path to a SQL Server table. After testing the issue in my environment, we can refer to the following steps to achieve your requirement:
Create two variables, VarFolderPath stores the folder path in which our files exist, VarFileName hold the value of most recent File Name.
Drag a Script Task from SSIS Toolbox to Control Flow Pane, then select “User::VarFolderPath” as ReadOnlyVariables, select “User::VarFileName” as ReadWriteVariables.
Then Edit Script with the C# code below:
Add “using System.IO;” into namespace.
Add the code below under Main function:
var directory= new DirectoryInfo(Dts.Variables["User::VarFolderPath"].Value.ToString());
            FileInfo[] files = directory.GetFiles();
            DateTime lastModified = DateTime.MinValue;
            foreach (FileInfo file in files)
                if (file.LastWriteTime > lastModified)
                    lastModified = file.LastWriteTime;
                    Dts.Variables["User::VarFileName"].Value = file.ToString();
Drag a Data Flow Task to Control Flow Pane and connect to Script Task.
In the Data Flow Task, drag a Flat File Source with a file in the source folder as all the files have same structure as the File name.
Add the property below the Flat File Connection Manger expression:
Property: ConnectionString      Expression: @[User::VarFolderPath] +"\\"+ @[User::VarFileName]
Drag an OLE DB Destination that connect to the Flat File Source, then configure a table to store the data.
The following screenshot is for your reference:
If there are any other questions, please feel free to ask.
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support