Why the files my program create are created twice each file double ? And why sometimes the files size are too small ?

Question

My program is using Queue of type Uri to create Queue of urls and then i'm using webbrowser to navigate each Uri from the Queue in it's turn and get the url(html) source content and save it to the hard disk.
The problem is sometimes the text files on the hard disk are small like 90KB or 60KB and sometimes they are as they are suppose to be 300KB or 200KB.
This is a button click event where i'm calling two methods:
private void toolStripButton3_Click(object sender, EventArgs e)
GetHtmls();
CheckQueue();
This is the GetHtmls method code:
private Queue<Uri> myUrls = new Queue<Uri>();
private bool isBusy = false;
private void GetHtmls()
for (int i = 1; i < 49; i++)
adrBarTextBox.Text = sourceUrl + i;
targetHtmls = (combinedHtmlsDir + "\\Html" + i + ".txt");
Uri targetUri = new Uri(sourceUrl + i);
myUrls.Enqueue(targetUri);
sourceUrl contain website address: http://www.tapuz.co.il/forums2008/forumpage.aspx?forumid=393&pagenumber=
And i'm adding to it the numbers and create the pages.
And add them to the Queue.
THen the CheckQueue method:
Uri uri;
private void CheckQueue()
if (isBusy)
return; // We're downloading some page right now, don't disturb
isBusy = true; // OK, let's get started
if (myUrls.Count == 0) // No more pages to download, we're done
isBusy = false;
return;
uri = myUrls.Dequeue(); // Get one URL from queue
getCurrentBrowser().Navigate(uri);
It suppose to Navigate to each Uri(html address) in the Queue.
And the browser document completed event:
private void Form1_DocumentCompleted(object sender, WebBrowserDocumentCompletedEventArgs e)
// If page loaded completly then do something
int urlnumber = uri.ToString().IndexOf("pagenumber=");
string number = uri.ToString().Substring(urlnumber + 11);
int num = Int32.Parse(number);
targetHtmls = (combinedHtmlsDir + "\\Html" + num + ".txt");
StreamWriter writer = File.CreateText(targetHtmls);
writer.Write(getCurrentBrowser().DocumentText);
writer.Close();
isBusy = false; // We're done
CheckQueue(); // Check next page in queue
In the completed event i'm getting the page number and build the string for the text file then write the html source content to the text file.
In the end i have on my hard disk 48 text files.
The problems are:
1. Sometimes it seems like it's not finishing navigating to the current uri or maybe some other reason maybe server side problem and creating small size files with source content inside but not all the source content. Sometimes the text files size are each
file 99KB or 70KB and sometimes the size of them are about 300KB and 200KB and this is the right sizes 300KB 200KB.
2. The text files on my hard disk suppose to be 48 different files each file should contain the source if the html page of the 48 pages. But on my hard disk the 48 text files are duplicated for some reason.
This is the file on my hard disk:
Some of the files are 205KB 350KB 175KB and some of the files sizes are 85KB 94KB 35KB 
Why some of the files it didn't navigated to the end or maybe didn't got all the source ?
And why it's making each second file the same like the one before ? It suppose to create 48 different files but i'm getting two identical files each navigation.

Answer 1

I solved it now.
This is what i did:
It's a bit slow process since i'm waiting for each page to be loaded into the webbrowser but it does the work.
using System;
using System.Collections.Generic;
using System.ComponentModel;
using System.Data;
using System.Drawing;
using System.Linq;
using System.Text;
using System.Threading.Tasks;
using System.Windows.Forms;
using System.Collections;
using System.IO;
using System.Net;
namespace WindowsFormsApplication1
public partial class Form1 : Form
private string sourceUrl = "http://test.test";
private string htmlsTargetDirectory = "Test Htmls";
private string appDir = Path.GetDirectoryName(@"C:\Users\chocolade1972\AppData\Local\Test_Images\Test Images\Test Htmls");
private string combinedHtmlsDir;
private String targetHtmls;
private int counter = 1;
private StreamWriter w;
private string uri;
private bool htmlloaded = false;
public Form1()
InitializeComponent();
webBrowser1.ScriptErrorsSuppressed = true;
combinedHtmlsDir = Path.Combine(appDir, htmlsTargetDirectory);
if (!Directory.Exists(combinedHtmlsDir))
Directory.CreateDirectory(combinedHtmlsDir);
private void Form1_Load(object sender, EventArgs e)
GetHtmls();
timer1.Enabled = true;
private void GetHtmls()
uri = sourceUrl + counter;
targetHtmls = (combinedHtmlsDir + "\\Html" + counter + ".txt");
webBrowser1.Navigate(uri);
private void webBrowser1_DocumentCompleted(object sender, WebBrowserDocumentCompletedEventArgs e)
if (e.Url.ToString() == uri)
targetHtmls = (combinedHtmlsDir + "\\Html" + counter + ".txt");
htmlloaded = true;
StreamWriter writer = File.CreateText(targetHtmls);
writer.Write(webBrowser1.DocumentText);
writer.Close();
FileInfo fi = new FileInfo(targetHtmls);
var size = fi.Length;
w = new StreamWriter(combinedHtmlsDir + "\\test.txt", true);
w.WriteLine("File Size " + size);
w.Close();
private void timer1_Tick(object sender, EventArgs e)
if (htmlloaded == true)
uri = sourceUrl + counter;
myurls.Add(uri);
webBrowser1.Navigate(uri);
htmlloaded = false;
counter += 1;