Problems crawling websites - website does not show in root

Hi guys
I have problems accessing a couple of websites, and they all seem to have the same problem, so I would really appreciate your help.
I have set up the web repositories according to "How to set up a Web Repository and Crawling it for Indexing", but I cannot see the website in the KM root. If I go to the component monitor and take a look at the repositories there, I can see the following error is returned: "HEAD /: 401 Access Denied".
I have noticed that these three sites have a pop-up, where you have to type in user/pass in order to access the webservers. Is the information entered in the HTML system under "User" and "Password" not forwarded to this dialog-box?
Or is there another place where I have to type in user/pass before the crawler is able to automatically enter and crawl the site?
Any help will be rewarded.
Best regards,
Martin

I am having a similar problem which I will describe in a second, but first I'll help you narrow your problems.
I have successfully created web repositories before on sites that require authentication for the purpose of indexing.  In these cases, the web repository manager will still create a file in the KM root.  You will not be prompted for authentication until you open the link to the repository within the folder that is created by the web reposity manager in KM.  This prompt for the purpose of crawling can be remedied by making the start page for your website include a header with the required credentials.  For example, for the http system www.mysite.com, your website start page would be www.mysite.com/default.asp?<my_credentials>.  This allows the credentials to be posted automatically to the webserver when you begin crawling.
As for your problem of no folder being created, that is a seperate issue.  I have 2 portals up and running right now.  The newest one was a clean install of EP60 and KM at SP9 that I immediately upgraded to SP14.  This one will for some reason not create any web repository folders in KM.  My other portal that was installed at SP9 then upgraded to SP12, then SP13, then SP14 does not seem to have any issues.  I am thinking perhaps some required service gets overwritten over eliminated that automatically creates the folder for the web repository in KM.  It could also be something to do with dialog instances or additional server nodes.  I know that some automated processes have to be manually configured after installation of a dialog instance or addition of server nodes.  My working poral has 2 sever nodes and no dialog isntances. The one with web repository problems has 3 server nodes and one dialog instance.  Anyone else having this problem or know a solution?

Similar Messages

  • Have just installed PE12 with no install problems. Share preference does not show any email preferences, just the default Adobe.

    PE12 just installed, but Organizer share preference for emailing photos does not show any email preferences except the default Adobe. Have Visa with Windows Mail. Previous PE worked OK.  How to resolve?

    Please post Photoshop Elements related queries over at
    http://forums.adobe.com/community/photoshop_elements

  • GX660 SSD Caching problem - the accelerate tab does not show

    Ok so im trying to install a crucial m4 64 gb (FW 0009) into my gx660 and enable it as a ssd cache via the intel RST program. So far with no luck.I've ran into a wall and my problem is that the accelerate tab in intel rst is not showing.
    Here is what i did. Hopefully in the right order.
    1. I installed and updated the intel RST drivers and software.
    2. I installed the ssd in the empty drive slot in the case.
    2. I flashed my BIOS to the gx660r one to enable the RAID option.(before this i also found out that 1 of my 2 ramsticks where bad and i took it out)
    3. I enabled RAID only to discover windows would BSOD on boot and i disabled it again (sat it back to AHCI)
    4. I used these registry hacks to get RAID mode to work.
       Enable switching between all IDE/AHCI/RAID modes by changing "Start" Values in these keys to 0
             HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Msahci\Start
             HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Pciide\Start 
             HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\iaStorV\Start
    5. I re-enabled RAID mode and booted into windows perfectly
    6. Then intel RST bugged on me and i reinstalled it several times. (it showed my disk as having 0 gb's of space and was only able to show their serial number)
    7. I got intel RST working but it still wont show the Acellerate tab :(
    At this point i got stuck when the accelerate tab still wasnt showing and now i tried making a clean install of windows (in RAID mode) on a newly created partition. Here i have the same problem.
    I have also tried switching the drives places in the case but still no luck.
    I have gotten to the point where im about to give up on this. Do any of you have any idea of what i've done wrong? if so please reply.

    ... Note to self: Do proper research. Turns out youre probably right.  According to http://www.tomshardware.com/reviews/intel-z68-express-smart-response-technology-ssd-caching,2938-3.html it is also possible on HM67 and QM67 chipsets but thats not what i have. Thought that SSD caching support was a nobrainer on laptops but turns out its not.

  • Trying to set up Express to extend network. Had problems and now it does not show up in the Utility window? How can I overcome this?

    It just blinks Yellow but will not show up in list so I can work with it. What do I do? Is it now a brick?

    On the AirPort Extreme setup.....I assume that you did enter a check mark in the box next to "Allow this network to be extended"
    Otherwise, the following instructions will be of no value.
    Temporarily, connect the Ethenret cable from your computer to the AirPort Express (AX) and power up the AX in the same room or close proximity to the AirPort Extreme.
    Open AirPort Utility, select the AX, and click Manual Setup
    Click the Base Station tab just below the row of icons to name the AX, assign a device password (write that down) and adjust Time Zone settings
    Click the Wireless tab next to the Base Station tab. Settings should look like this:
    Wireless Mode = Extend a wireless network
    Wireless Network Name = Same name as the AirPort Extreme wireless network
    Check mark entered next to Allow Wireles Clients
    Wireless Security = Same setting as the AirPort Exreme network
    Wireless Password = Same password as the AirPort Extreme network
    Confirm Password
    Click Update
    As soon as you see the message that the settings have been stored, close AirPort Utility and disconnect the Ethernet cable
    Wait 40-45 seconds for the AX to restart and you should have a green light
    Locate the AX approximately 1/2 the distance from the AirPort Extreme to the area that needs more wireless coverage and power it up
    The AX should now be providing more wireless coverage

  • Flash website problem / jpg in xml does not show in different browsers

    Hello Everyone,
    I am working on a flash website which is almost finished.
    My problem is that I created dynamic loading content, so the contents in the flash ( Most of them) loads from .xml files. This xml contains text and jpg.
    when i test the movie and final html it works perfectly and xml loads with all its contents in any browser.
    but when I upload the website through FTP, the xml shows very strange ! . In IE only half of the jpgs loads and some content repeat itself, while in firefox none of the jpg loads.
    The only images I can see are the one that I have directly put on the flash pages.
    Does anyone knows a solution? I am desperatly trying to figure this out!!
    I appriciate your answers.
    Kara
    the website address: http://www.hofstede-symposium.eu/

    I could figure the problem just right now. so Easy!!
    I just changed the slash es in xml . So if  the original one was : "thumbnail\my.jpg "  I chanegd the slash forward "thumbnail/my.jpg". I also put the xml file, my images and swf. file in the same folder.
    I tried it and it worked in firefox, google chrome and IE.
    Hope it helped!! 

  • Website does not show images or styles.

    Okay, so last night my site was working just fine, im just testing out what i have so far which is not much. but then i re did the ftp and loaded and now its only text on a white page all bunched up in the top left corner. idk what i did wrong but i did click yes to a dependent file pop up by accident. i ment to hit no im not sure if thats what messed it up or not but idk why all of a sudden it not working.
    Been trying to fix this problem for at least 5 hours now and cant find anything on the web.
    Thanks,
    Dominic

    Looks like you are getting what you paid for -
    You are seeing this page because the system administrator of 000webhost.com is currently checking this website for malicious content. This redirect page will be removed once we finish manually checking all files on this account. Since we check over 100 websites per day, it can take about 2-4 hours to complete. If you are the owner of this website, you will get an email confirmation once it's done. If you are a visitor, please come back later.
    www.000webhost.com is the most popular free web hosting provider, and as such, suffers from abusers. Around 5% of users sign up here just to start hacking or phishing websites or causing other problems. So, in order to survive, we must monitor what our users are hosting.
    We are sorry for the inconvenience, but checking all content manually is the only way to provide you with the most secure and reliable service. If you find any illegal websites on our network, you can report it here.

  • Background for site does not show up after uploading to webhost...

    My background for my website does not show up on my webhost after uploading site with Dreamweaver.
    Here is my site: http://legacyofys.comxa.com/
    Here is the backgroud image: http://point-file-manager.000webhost.com/index.php?ftpserver=legacyofys.comxa.com&ftpserve rport=21&username=a2022293&language=en&skin=blue&ftpmode=automatic&passivemode=no&sslconne ct=no&viewmode=list&sort=&sortorder=&state=view&state2=image&directory=%2Fpublic_html%2Fim ages&entry=Background.png
    I know the background image successfully uploaded to my webhost, because it shows up in my file manager. What is wrong here? How do I fix this?

    So it was a path issue  :-)  Glad you sorted it .
    Nadia
    Adobe® Community Expert : Dreamweaver
    Unique CSS Templates |Tutorials |SEO Articles
    http://www.DreamweaverResources.com
    Book: Ultimate CSS Reference
    http://www.sitepoint.com/launch/005dfd4/3/133
    http://twitter.com/nadiap

  • Apple TV (1st gen) does not show up in iTunes 11

    I have a 1st generation Apple TV.  It seemed to be working fine, except that my shared music did not appear under My Music.  I thought maybe there was a connectivity issue with iTunes, so I decided to disconnect from iTunes and then re-link to iTunes.  The problem is, the AppleTV does not show up under devices in iTunes.  If I go to Preferences-AppleTV, it does show up with a status of "syncing", however, the Apple TV does not show it is connected to iTunes. I tried removing it in Preferences-AppleTV on the iMac, but it reappears after a few minutes, again with a status of "syncing".  I have verified both the iMac and Apple TV are connected to the correct network, both have the correct AppleID and password.  iMac is running Snow Leopard, iTunes 11.02 (absolutely HATE version 11), Apple TV 3.02.
    Two questions:
    1.  How do I get iTunes to see my Apple TV so I can enter the 5 digit code and connect?
    2.  Once that is done, how do I get it to show my shared music library (Movies and TV shows were there previously, just not Music)?

    I have the same problem. It was working fine up until the last update for iTunes 11.0.2
    Here's the details:
    I have an Apple TV - first Gen and up until a couple of weeks ago, was regularly playing sync'd iTunes music and videos through it on a daily basis.
    I see other devicess showing up in the "Devices" list in the left panel of iTunes (such as iPad, iPhone, etc.)
    AppleTV used to be there consistently, then disappeared upon update to 11.0.2
    Apple TV also does not show up in the devices tab under the Preferences window.
    I have tried multiple suggestions on the support forum but none have worked.
    Apple TV is able to access the network, is on the same network as the iMac with iTunes library connected. Both are connected to network via ethernet cable (not wifi). Both are able to access the internet (apple tv plays movie prieviews and gets updates). Using the Terminal app, I am able to ping the apple TV's IP number from the iMac and get a successful return. 
    Both have latest software downloads.
    I have tried cold-booting the apple TV, resetting the router, and verified in the router device list that both imac and appleTV are listed as active, un-blocked connections.
    I don't intend to buy an Apple TV 2nd gen or later (since I bought this one and it's not working now due to software update, what guarantee that a later model won't generate the same problem later.
    One last wrinkle, I have a 2 year old and a 5 year old who are jonesing hard for their "dance party" fix.
    Have you ever wronged a two year old?
    It is NOT pretty.
    Help me Apple-wan-kenobi...I can't take the screaming!

  • Just installed PE12. Sharing Preference does not show email preferences, only Adobe. Previous PE worked. Vista Windows Mail

    Have just installed PE12 with no install problems. Share preference does not show email preferences, just the default Adobe. Previous PE worked for sending email attachments, Vista with Windows Mail. How do I get Windows Mail as the share email preference?

    Please post Photoshop Elements related queries over at
    http://forums.adobe.com/community/photoshop_elements

  • Image does not show up!

    Hello. Im studying java swing and working on some experiment and badly need some help. Im using Graphics2D and not JLable or Icon for some reason. The problem is the image does not show up. What could be the reason and work around? Another, do you know any tutorial on the said matter? Thanks in advance.
    import java.awt.*;
    import javax.swing.*;
    public class ShowImageGraphics
         //Graphics2D g2;
         public static void main(String[] args)
              new ShowImageGraphics();
         public ShowImageGraphics()
              JFrame frame = new JFrame("Sample Graphics");
              frame.setSize(200, 300);
              frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
              frame.getContentPane();
              frame.show();
         public void paint(Graphics g)
               Graphics2D g2 = (Graphics2D)g.create();
              Image img = Toolkit.getDefaultToolkit().getImage("/images/rocketship.gif");
              g2 = (Graphics2D)g;
              g2.drawImage(img,14,5,33,40, null);
    }

    import java.awt.*;
    import java.awt.image.*;
    import java.net.*;
    import javax.swing.*;
    public class ImageExample {
        public static void main(String[] args) throws MalformedURLException {
            URL url = new URL("http://today.java.net/jag/bio/JagHeadshot.jpg");
            JLabel label = new JLabel(new ImageIcon(url));
            JFrame f = new JFrame("ImageExample");
            f.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
            f.getContentPane().add(new JScrollPane(label));
            f.pack();
            f.setExtendedState(JFrame.MAXIMIZED_BOTH);
            f.setVisible(true);
    }

  • Miix 3 does not show battery status in Taskbar

    Hi,
    I own a new Miix 3 that works w/o problems. But it does not show the current battery status in the task bar or anywhere else. I checked windows' Device manager. There is no battery listed, only the external power device. I assume Windows 8.1 does not recognize the tablets' battery or the driver is missing. It seems the software/drivers is up to date.
    Does anyone else have the same problem or see a solution for that problem?
    Thanks in advance,
    Kauzi

    Being able to see at a glance which files are checked out/by whom below each thumbnail would be infinitely valuable, and is therefore not an option in Bridge Thumbnail Preferences. :)
    If you enable Tooltips in Thumbnail Preferences, the Vc status is shown there, but one still must click or hover over each and every file to get the real Vc status. And of course, as you pointed out, the Vc status is always available for individual files in the Inspector Panel.

  • Firefox does not show full websites

    Suddenly, Firefox does not show complete websites. IE does just fine.
    Here's sample:
    http://i40.tinypic.com/lboxv.jpg
    What do we do? Some sites show fine, some like this - a list view, or whatever. And it's not online issue, as like I said - IE shows same sites just fine.

    Hello ukrkoz, if you have the same issue again try to clear cookies and cache. Many site issues can be caused by corrupt cookies or cache. In order to try to fix these problems, the first step is to clear both cookies and the cache.
    Note: ''This will temporarily log you out of all sites you're logged in to.''
    To clear cache and cookies do the following:
    #Go to Firefox > History > Clear recent history or (if no Firefox button is shown) go to Tools > Clear recent history.
    #Under "Time range to clear", select "Everything".
    #Now, click the arrow next to Details to toggle the Details list active.
    #From the details list, check ''Cache'' and ''Cookies'' and uncheck everything else.
    #Now click the ''Clear now'' button.
    Further information can be found in the [[Clear your cache, history and other personal information in Firefox]] article.
    Did this fix your problems? Please report back to us!
    Thank you.

  • Internet Explorer does not show photo's on website

    I made a website with iWeb. It looks fine on Safari and Mozilla Firefox but Internet Explorer does not show any of the photo's I have put on. Any solutions out there? Thanks in advance.

    usually this isn't relevant to the Mac side of things, but on the PC side of things do you have McAfee Privacy Service installed on the PC? if so, try disabling that and having another look in IE 6. can you see the buttons now?
    on the Mac side of things ... do you have java/javascript enabled?

  • FF does not show "click on boxes" on websites.

    in FF 16.0.2 (and prior FF also): The "order" box in amazon does not show up. The rating "stars" on Netflix do not show up. On many websites boxes you need to click on do not show up. The boxes are there, but are invisible . If you know where to "click" they will work but most of the time you can't find them. If you find the right invisible spot, the "hand" shows up and you can click the invisible box.

    I don't know what to do in Universal Access. I don't see anything that would apply.
    You can see in the shot below on the Amazon page on the right side below "Quanity" there is no box to click. I can click the empty space and I can order just fine because I know where the box is supposed to be. On other sites however there is no indication where the "continue" or "order" box may be and it is often impossible to move the cursor around until you bump into the invisible box and get a "hand" to pop up. If there are two missing boxes as in "yes" or "no", or "order" or "cancel", even if you find a invisible box, you don't know if you are clicking on "yes" or "no".
    On the Netflix shot there is supposed to be 5 stars below each movie. As you can see, they are invisible. I can find them because I no where to look but I can't rate the movie with my "hand" cursor because I can't tell which of the 5 stars I am pointing to.
    Thanks for your help

  • I downloaded Firefox 4.0. Spellchecker is included and I have downloaded English Dictionary as Addon. It does not work on website. Spellchecker does not show up in Context Menu. I have tried every other source. Can you help please?

    I understand that Spellchecker is pre-installed but I cannot verify this is the case with v.4.0 Firefox. I have right-clicked on webpages and it does not say Dictionary is missing, so I assume the problem remains with Spellchecker. I expected to find Spellchecker and Languages under Edit in nav bar but it does not show up, What must I do? Richard

    That should work on a Mac as well.
    You did download and install the French version?
    Download a new copy of the Firefox program and save the DMG file to the desktop
    * Firefox 4.0.x: http://www.mozilla.com/en-US/firefox/all.html
    * Trash the current Firefox application to do a clean (re-)install
    * Install the new version that you have downloaded
    Your profile data is stored elsewhere in the [http://kb.mozillazine.org/Profile_folder_-_Firefox Firefox Profile Folder], so you won't lose your bookmarks and other personal data.

Maybe you are looking for

  • How many computers can I install CC on?

    I have a couple of computers at home that I work from, am I able (with the individual license) to install on multiple computers?

  • IPhone - Typing lag, text scrolling, lag

    Hi all, After upgrading to 2.0 I've experienced lag while typing in many areas (text, Safari, Contacts, etc.) - it takes a second or two for the screen to display what I've entered. At this point, I'm able to type a few words before it decides to dip

  • Help I forgot my first Apple ID.

         Please help me. I restores my frozen iPad on the computer and now it is aasking fo an activation ID. In the text it says k^^^^^@k^^^^^.com. I wouln't let me skip this if I don;t get past this I woulnt be able to use my iPad at all. I tried reset

  • 16:9 playback on apple monitor

    hi everyone, this is my first post so i hope someone can help. i use a conon xl2 to film and i edit in final cut express hd. i film in 16:9 and can edit no problem, i can also export a self contained quicktime movie and burn it to dvd, no problem. i

  • Run PE8 (and PSE8) with 64-bit Win 7

    My hardware Dell XPS 600 desktop 3.2 Mhz Intel Pentium D 64-bit Win 7 OS (full clean custom install) dual-STI NVIDIA GForce 6800 video cards (w/64-bit drivers) 6 GB RAM What's the latest word on successfully running PE8 (and PSE8) with 64-bit Win 7 (