JTable and large CSV files

Question

I have been looking for a clear answer (with source code) to a problem commonly asked in the forums. The question is "how do I display a large comma delimited (CSV) file in a JTable without encountering a Java heap space error?" One solution is described at http://forum.java.sun.com/thread.jspa?forumID=57&threadID=741313 but no source code is provided. Can anyone provide some example code as to how this solution works? It is not clear to me how the getValueAt(r, c) method can be used to get the (r+1)th row if only r rows are in the TableModel. I greatly appreciate any help.

Answer 1

Perhaps if I posted my code, I might get a little help. First, my class that extends abstract table model
public class DataTableModel extends AbstractTableModel{
     private static final long serialVersionUID = 1L;
     Object[][] data;
     DataColumnFormat[] colFormat;
     int nrows, ncols, totalRows;
     public DataTableModel(Object[][] aData, DataColumnFormat[] aColFormat, int aTotalNumberOfRows){
          data=aData;
          colFormat=aColFormat;
          nrows=data.length;
          ncols=data[0].length;
//          number of rows in entire data file.
//          This will be larger than nrows if data file has more than 1000 rows
          totalRows=aTotalNumberOfRows;
     public int getRowCount(){
          return nrows;
     public int getColumnCount(){
          return ncols;
     public String getColumnName(int aColumnIndex){
          return colFormat[aColumnIndex].getName();
     public Object getValueAt(int r, int c){
          if(colFormat[c].isDouble()){
               return data[r][c];
          return data[r][c];
     public boolean isCellEditable(int nRow, int nCol){
          return true;
     @SuppressWarnings("unchecked")
     public Class getColumnClass(int c) {
        return getValueAt(0, c).getClass();
     protected void updateData(){
//          replace values in data[][] object with new rows from large data file
}Suppose data = new Object[1000][100] but my CSV file has 5000000000 lines (to exaggerate). By my understanding getValueAt(r, c) could not go beyond r=1000 and c=100. So, how would I update data with the next 1000 lines by way of the getValueAt(r,c) method? Moreover, how would I implement this so that the table appears to scroll continuously? I know someone has a solution to this problem. Thanks.