To processa huge data with good speed and also paint the same data!

Question

In my project genebrowser in which i am plotting gene, snp, and various other map, I am teking input as a flat file and also page is dynamic like user can change the coordinate view that he wants to see.
1. We have to plot GC percentage after reading the file and this GC % data is of around 10-15 MB size.How to manage this?"
2. due to plotting this huge data the painting of components get very slow.how to manage this?

Answer 1

If you use SS2008 and onward take a look at table valued parameter
create table myTable (col1 int, col2 datetime, col3 varchar(max))
go
create type myTableType as table (col1 int, col2 datetime, col3 varchar(max))
go
create procedure up_myTable_insertFromTable 
  @myTableData myTableType readonly
as
  insert into myTable (col1, col2, col3 )
  select col1, col2, col3 
    from @myTableData 
go
declare @myTable myTableType
insert into @myTable values(1, getdate(), 'Table Valued Parameters are great')
exec up_myTable_insertFromTable @myTable
The stored procedure parameter has to be READONLY. 
This means that you cannot modify it within the stored procedure. 
You can only modify it in the scope it was created. i.e.
 If you created a table type variable in your procedure you can modify the data in it, 
however if you pass that to another procedure that other procedure cannot modify it as it wasn't create 
in the scope of that procedure.
Otherwise
1 /*
    2 Here is the string that we need to split
    3 */
    4 DECLARE @str VARCHAR(100)
    5 SET @str = '0001,0002,0003,0004,0005'
    6 
    7 /*
    8 I am converting the string to an XML structure by 
    9 inserting XML tags.
   10 */
   11 DECLARE @x XML 
   12 SET @x = '<i>' + REPLACE(@str, ',', '</i><i>') + '</i>'
   13 
   14 /*
   15 Now we can apply XQuery to return a result set
   16 */
   17 SELECT x.i.value('.', 'VARCHAR(4)') AS Item
   18     FROM @x.nodes('//i') x(i)
   19 
   20 /*
   21 Item
   22 ----
   23 0001
   24 0002
   25 0003
   26 0004
   27 0005
   28 
   29 (5 row(s) affected)
   30 */
Best Regards,Uri Dimant SQL Server MVP,
http://sqlblog.com/blogs/uri_dimant/
MS SQL optimization: MS SQL Development and Optimization
MS SQL Consulting:
Large scale of database and data cleansing
Remote DBA Services:
Improves MS SQL Database Performance
SQL Server Integration Services:
Business Intelligence