Problem in cookie handling using CookieManager java1.6

Question

Hi all...
I found that there is a no cookies are catched from http response for some web sites are requested by using CookieManager() in jdk1.6.
following is source code where i test this case....
import java.io.;
import java.net.;
import java.util.*;
public class Fetch {
public static void main(String args[]) throws Exception {
String urlString = "http://www.google.com";
//urlString = "http://apps1.ubs.com/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1";
CookieManager manager = new CookieManager();
manager.setCookiePolicy(CookiePolicy.ACCEPT_ALL);
CookieHandler.setDefault(manager);
URL url = new URL(urlString);
URLConnection connection = url.openConnection();
if (connection instanceof HttpURLConnection) {
HttpURLConnection httpUrlConnection = (HttpURLConnection) connection;
httpUrlConnection.setInstanceFollowRedirects(true);
httpUrlConnection.connect();
BufferedReader bufferedReader
= new BufferedReader(
new InputStreamReader(
httpUrlConnection.getInputStream()));
StringBuffer stringBuffer = new StringBuffer();
String line = null;
while ((line = bufferedReader.readLine()) != null) {
stringBuffer.append(line);
stringBuffer.append("\n");
System.out.println(stringBuffer.toString());
CookieStore cookieJar = manager.getCookieStore();
List<HttpCookie> cookies = cookieJar.getCookies();
for (HttpCookie cookie: cookies) {
System.out.printf("\nCookie: %s%n", cookie);
}It is working well using for google web site but not working for ubs.com. i give the requested page in variable urlString remove the comment at lineno 8 after finish the normal test. It will not print any cookies for this website..But i found Cookies for both web site using httprequesttracker.
Here is Mozilla firefox request and response for both web site....
http://www.google.com/
GET / HTTP/1.1
Host: www.google.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
HTTP/1.x 302 Found
Location: http://www.google.co.in/
Cache-Control: private
Set-Cookie: PREF=ID=8117eafc8d1868c5:TM=1213001085:LM=1213001085:S=iJitvzgWFvKmDTZm; expires=Wed, 09-Jun-2010 08:44:45 GMT; path=/; domain=.google.com
Date: Mon, 09 Jun 2008 08:44:45 GMT
Content-Type: text/html; charset=UTF-8
Server: gws
Content-Length: 221
http://www.google.co.in/
GET / HTTP/1.1
Host: www.google.co.in
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
HTTP/1.x 200 OK
Cache-Control: private
Content-Type: text/html; charset=UTF-8
Set-Cookie: PREF=ID=707e00e4cd0dddda:TM=1213001085:LM=1213001085:S=kXfAKdv-DMuiSWXp; expires=Wed, 09-Jun-2010 08:44:45 GMT; path=/; domain=.google.co.in
Content-Encoding: gzip
Date: Mon, 09 Jun 2008 08:44:45 GMT
Server: gws
Content-Length: 2930Following is for usb.com website
http://apps1.ubs.com/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1
GET /locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1 HTTP/1.1
Host: apps1.ubs.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
HTTP/1.x 302 Found
Date: Mon, 09 Jun 2008 04:47:06 GMT
Server: Apache
Pragma: no-cache
Connection: close
Location: http://apps.ubs.com:80/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1
Cache-Control: no-cache
Content-Length: 318
Content-Type: text/html; charset=utf-8
http://apps.ubs.com/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1
GET /locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1 HTTP/1.1
Host: apps.ubs.com:80
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
HTTP/1.x 302 Found
Date: Mon, 09 Jun 2008 04:47:08 GMT
Server: Apache
Pragma: no-cache
Set-Cookie: NavLB_Apps=apps1.ubs.com; Domain=.ubs.com; Path=/; Version=1; HttpOnly
Connection: close
Location: http://apps1.ubs.com:80/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1&NavLB_Apps=1212986828
Cache-Control: no-cache
Content-Length: 345
Content-Type: text/html; charset=utf-8
http://apps1.ubs.com/locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1&NavLB_Apps=1212986828
GET /locationfinder/searchForm.do?GeoEntityId=1&GeoEntityType=1&NavLB_Apps=1212986828 HTTP/1.1
Host: apps1.ubs.com:80
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Cookie: NavLB_Apps=apps1.ubs.com
HTTP/1.x 200 OK
Date: Mon, 09 Jun 2008 04:47:08 GMT
Server: Apache
Content-Language: en-US
Set-Cookie: JSESSIONID=0000vHz5HlsSRtRwAgUVx0Il0oW:-1; Path=/; Version=1; HttpOnly
Cache-Control: no-cache="set-cookie,set-cookie2"
Expires: Thu, 01 Dec 1994 16:00:00 GMT
Content-Type: text/html;charset=ISO-8859-1
Connection: close
Transfer-Encoding: chunkedI dont know wat is the problem with this CookieManager() in java1.6...
But it is working well and print cookiees
By replace line 10
CookieHandler.setDefault(manager);to
CookieHandler.setDefault(new ListCookieHandler());code for ListCookieHandler.java is avalible in
[http://java.sun.com/developer/JDCTechTips/2005/tt0913.html#1|http://java.sun.com/developer/JDCTechTips/2005/tt0913.html#1]
please give some idea for solve this problem....

Answer 1

You are using Firefox 2.x, so i think that the cookie for the usb.com website is no http cookie, it's probably a "DOM Storage"
(if you use an actual IE instead, then the "Set-Cookie" lines may stay anyway then it will be the "userData behavior" feature of MS).
They both are looking similar to http-cookies because they are a kind of cookie too, but with another (more common) format.
I'm not so familar to their format, so it is only an assumption (maybe another can affirm or disprove this), but i remembered that
DOM Storage and userData behaviour Cookies were designed to manage persist data across multiple browser sessions -
and on the usb.com website it is indeed starting a session (JSESSIONID=0000vHz5HlsSRtRwAgUVx0Il0oW).
(To be sure, that this is a DOM storage you have to watch the behaviour of this cookie and the server, or you can watch the
size of this cookie over a longer periode, if it grows much greater than 4KB it is one (DOM Storage and userData behavior can
grow of up to nearly 6 MB), or the easiest way if you can login, do it and look if you are logged in the next day, too)
So there is no problem with the CookieManager() in java1.6, that is only providing "HTTP cookie management"
(see CookieManager and CookiePolicy), while ListCookieHandler seems to be a more common approach.
Edited by: penpen on Jul 6, 2008 4:41 AM