Php extract url's from recordset

Hello guys,
I need to extract url images from a recordset (the recodset is an html page) for build a feed.
To do this I use regular expression to find url and I get the results with print_r function.
Good, now I need to replace the array key with xml tags, to do this I need to replace the array key with regular expression ?
I think that is not the best way...

Hello again, someone know if exist a regular expression generator tool online ?

Similar Messages

Help extracting URL's from PDFs I create

Using Acrobat pro 9.+ I have several PDF catalogs I have created, and what I need t
o do is extract the URL's for each 100 page catalog.
These are added URL's using the Acrobat linking tool
Ideally they would be one URL per row, and have at least a minimum amout of information.
1. URL
2. (if possible, the page the URL is from)
Thank you

maybea two step process? one applescript that extracts to a text file, and then an automator that can read that file (can autoamtor read froma text file?) and do what you want?
Jason

Auto-extracting URL LINKS from webpage?

is there a way to extract all the linked url's from a webpage?
i am trying to put together some lists and would like to gather these up and then insert them into a numbers spreadsheet. in some cases there are 30 to 50 of these listed on the left hand side of a webpage and right now I imagine clicking on a link, copying the url from the browser, inserting into numbers, clicking back, clicking on the next link etc.
is there a way to save some steps by exporting these to a text document and then copying and pasting from there?
thanks for any help.

You create the new bookmark with the javascript replacing the original URL from any old bookmark you have and no longer need, or just create a new bookmark for any thing at all specifically for your links script. Then once you are at a page where you want the links displayed, you just select your new links bookmark. Your page will stay open, but a new window will open as well, with all the links listed. You might want to change the size of the window, the width=400 and height=200 result in a pretty small window. Anyway, I put the Links javascript bookmarklet in my Bookmarks menu, so while I am here on this page I just go to the Bookmarks menu, slide down and select Links, and a new window opens with all the links on this page listed.
Francine
PS--It would be more impressive if I had written that script, but I didn't. I found it years ago and saved it with a batch of bookmarklets that do other useful things, such as suppressing animated gifs. I just checked, and a particularly useful collection, Jesse's Bookmarklets, still exists:
https://www.squarefree.com/bookmarklets/

How to send php email using email from recordset?

Hi
I know the headers to use for php mail(), and I use it for
the contact form for my viewers in order to contact the directory
listing's email address ( of which I have hidden by using the words
'Email Us' and use the id to carry through to the form).
I have sucessfully used the $to = [email protected] but when I
want to use the $row_?['email'] it will not send.
Any suggestions? I use a recordset to retrieve the id of the
listing to the contact form.
I will want to follow the same procedure for my jobseekers to
contact employers job adverts.
Thanks
Theresa

Hi,
There are many sms gateways that have their own api to send sms. You can use them for sms. (They will charge you for the sms!!!)
Moderator edit: Link removed
Thanks
Edited by: PhHein on 20.10.2010 16:11

PHP URL Variable from Insert Record Issue

I have a very simplistic forum style website I have put together. Everything is functionally properly except for one aspect. The basic structure is a page that lists the existing threads (ie: ThreadA, ThreadB, and ThreadC). I have the name of these threads stored in a MySQL database table that is used to generate a repeating dynamic table to grow as the number of threads increases. If the user clicks on one of these links they are taken to a page that displays all of the comments pertaining to that thread. All of the comments are stored in another MySQL database table. I perform a query on this comments page to filter the information in the comments database by the thread name which is passed over from the first page via a URL variable. The link attached to the name of the thread in the repeating table that generates the URL variable is "comments.php?thread=<?php echo $row_threads['threadName']; ?>" This works perfectly, If the user clicks on ThreadB they are taken to the comments page where only the comments pertaining to ThreadB have been filtered and displayed. After the user inserts a comment form ThreadB the comments page reloads displaying the newly created comment.
Also, on the first page, the user has the option to create a new thread; call it ThreadD. The name of this new thread has to be inserted into two tables; one in the master threads table and one in the comments page any time someone adds a comment. (I'm sure there is a better way to structure this, but this was all I could figure out and for my purposes at hand it is sufficient). When the user is taken to this new comment page I have a query set up to pull the last entry in the threads table from the logged in user, ie the newly created thread topic. I have dragged this query to the page to make sure it is pulling the correct thread heading, and it works just fine. What I'm wanting to have happen is after the user enters the first comment I'm wanting them to be redirected to the main comments page with their new comment listed; giving the illusion that the new comment and existing comments page are the same. I'm trying to pass the newly created thread name, ThreadD, in the URL to the main comments page just like I do if they select it from the existing threads page. Under the insert record wizard I click the 'browse' button to select the comments.php page. I then select 'parameters' to add the thread name query as the URL parameter. The generated code is "comments.php?thread=" . $row_threadName['threadName'] . "". The user does go to the main comments page but the URL variable is not coming with it. What I'm left with in the address bar is ..."/comments.php?thread=&" , but it should be ..."comments.php?thread=ThreadD". I tried copying and pasting the URL link from the existing threads page since that works perfectly, and when I do that the main comments page shows up blank after being redirected from the new comments page. If I hard code this, for testing purposes, into the redirect after insertion section (ie: "comments.php?thread=ThreadD") everything works perfectly and the URL in the address bar of the main comments page is "...comments.php?thread=ThreadD&" I noticed the extra "&", but didn't give it much thought since the site is giving me the behavior I'm looking for. My question is, how do I get this new comment page to pass the variable of the newly created thread name to the main comments page to behave like it does when the thread is selected from the list of existing threads? I know it has to do with how the URL variable is either being generated or built from my query, or how I have it listed in the redirect section of the insert wizard, but I can't figure out where I am going wrong. Please let me know if there are any questions or if I need to clarify any aspect. Any and all help is always appreciated. Thank you.

Ok, so just to summarize so I am understanding this correctly. You have an ordering page for tires/wheels. A customer places an order for tires/wheels and the data is submitted successfully and this includes a symbol for measurement (in.). But on another summary page the symbol is returning a blank value.
If this is correct we need to see:
- First, the code that is inserting the symbol to the database table in question
- Second, the query and code where you are printing the data to the screen.

Requesting help in extracting user comments from a forum ( HTML WEBSITE)

hello experts,
As i m new to java and i got this college project in hand which has to completed in few days i require some expert advise.
Basically what my job is to extract all the user comments from a forum and make a text file.. for example this is one of the website http://www.gsmarena.com where user have posted many reviews and comments about mobile phones . ex : http://www.gsmarena.com/nokia_n97-reviews-2615p2.php .
now looking at source code , all user comment are inside tag under <DIV class="user-thread"> element.
So i want to ask if there is any method in java that can extract all contents from class "uopin" directly ?
i have no problem opening URL connection and reading the webpage but i m not able to extract that specific content . please enlighten me in this regard.
Actually i m searching this forum since last 3 hours trying to find an answer and i found that i have to learn Regex , indexOf() subString() , HTMLEditorKit() etc.
I ma planning to learn them in detail but as i have very less time ( 2 days to be specific) , i want help from you experts to solve this problem. plz guide me with some code snippets .
Thankyou for your advises in advance :)

ok.. sorry for asking that way.
Here is my work till now....
i wrote this code :
import java.io.*;
import java.io.Console;
import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStreamReader;
import java.net.URL;
import java.util.regex.Matcher;
import java.util.regex.Pattern;
public class MyRobot3
 public static void main(String[] args) throws IOException
 BufferedReader in = new BufferedReader(new FileReader("MyRobot3.txt"));
 String inputLine , nextLine,kutta;
 FileOutputStream out; // declare a file output object
 PrintStream p; // declare a print stream object
 out = new FileOutputStream("myfile3.txt");
 p = new PrintStream( out );
 while ((inputLine = in.readLine()) != null)
 Pattern p1 = Pattern.compile("(<p\\sclass=\"uopin\">)(.*$)" );
 // Pattern p1 = Pattern.compile("(<p\\sclass=\"uopin\">)(.*$\r\n.*$)" , Pattern.MULTILINE | Pattern.UNIX_LINES); //not working
 //Pattern p1 = Pattern.compile("(<p\\sclass=\"uopin\">)(.*\\s)" , Pattern.MULTILINE );
 Matcher m1 = p1.matcher(inputLine);
 boolean found = false;
 while (m1.find())
 p.println(m1.group(2));
}I am testing with a little file MyRobot3.txt which contains
Although they didn't announce any winner here. But to me the winner is 
N900. Then opera is in second position. (overall averare result)And i am getting output in a file : myfile3.txt
Although they didn't announce any winner here. But to me the winner is which is just the first line , but i need to match that line break also. i m not able to figure it out .please help me fixing this code so that it can match all the text and remove the tag ..

Creating an xml file from recordset

Hi...
XML newbie here - so.
Is it possible to create and xml file from a recordset?
I need to create a datafeed of our e-commerce products.
Also, some of the db data contains HTML Code (product
description field),
how will this effect the xml file?
Another problem is that my xml file needs to contain url's
for the products
and product images. My ASP pages contain these URL in hard
code and then
pull the actual file names from the db
Hope that makes some sense
Thanks for any help
Andy

Hi David
Thanks for your help.
I think it will have to be option 1 as i am using Access DB.
I don't know how to go about it but will serach good old
Google.
Here is my recordset below, that pulls the required data from
Access.
The product and product image URL's need to be in the xml
file but only the
product image name and product id are in the database, e.g
image name
(imagename.jpg) productid (21)
The actual URL's are hardcoded in my ASP pages, e.g <img
src="products/medium/<%=(RSDetails.Fields.Item("Image").Value)%>"
Not sure if this makes things any clearer :-|
Thanks Again
Andy
<%
Dim RSdatafeed
Dim RSdatafeed_numRows
Set RSdatafeed = Server.CreateObject("ADODB.Recordset")
RSdatafeed.ActiveConnection = MM_shoppingcart_STRING
RSdatafeed.Source = "SELECT Products.Product,
Products.Description,
Products.Image, Products.image2, Products.ListPrice,
Products.Price,
Products.xml_feed, Manufacturers.Manufacturer,
Shipping.ShippingCost FROM
Shipping, Products INNER JOIN Manufacturers ON
Products.ManufacturerID =
Manufacturers.ManufacturerID WHERE
(((Products.xml_feed)=No));"
RSdatafeed.CursorType = 0
RSdatafeed.CursorLocation = 2
RSdatafeed.LockType = 1
RSdatafeed.Open()
RSdatafeed_numRows = 0
%>
"DEPearson" <[email protected]> wrote in
message
news:[email protected]...
> Andy,
>
> There are two ways you can create a xml file from a
recordset
>
> 1. Is to code it using Server.CreateObject(XMLDOM)
> 2. If you are using SQL server 2005, just request the RS
returns as XML
> data. using FOR XML AUTO after the where cause ( the
best way with 2005
> and
> higher sql server)
>
> The db data containing HTML code should not effect your
xml file, unless
> it
> is bad markup. You could wrap the data with
<![CDATA[the data or html
> markup, or javascript]]>
>
> If the url is a recordset field, then it will return
with the xml data.
> If
> not you can create a storage procedure that will build
your URL from the
> data
> in the database.
>
> It is best to use storage procedure (SP )for security
reason when pulling
> data
> from a MS Sql server, make all calls to the database in
a SP. Also be sure
> to
> validate the values in the querystrings before accepting
them, check for
> hack
> code.
>
> David
>

Extracting Image Links From HTML

Hi, at the moment am trying to extract image locations from the html files i.e. the "src" part of <img> tag. Have tried using HTMLParserCallback as I know this allow you to extract links from a page. However when I open a document I know to have <img> tags in it, handleStartTag() is not called, I only get all the other tags. Any idea how to solve this problem? Thanks very much,
Ross

Hi,
Here's a portion of a class I wrote a while back....
Note the useMap variable I introduced in the constructor.
Some HTML files had the images in a "map" attribute, others in an "imgmap" attribute.
regards,
Owen
private class CallbackHandler extends HTMLEditorKit.ParserCallback
 private HTML.Tag tag; // The most recently parsed tag
 private HTML.Tag lastTag; // The last tag encountered
 private int nested = 0;
 private boolean useMap;
 public CallbackHandler(boolean useMap)
 super();
 this.useMap = useMap;
 public void handleText ( char[] data, int pos )
 public void handleStartTag ( HTML.Tag t, MutableAttributeSet attSet, int pos )
 public void handleSimpleTag ( HTML.Tag t, MutableAttributeSet attSet, int pos )
 if ( t.toString().equalsIgnoreCase ( "input" ) )
 boolean imagemap = false;
 String name = null;
 String src = null;
 if ( attSet instanceof SimpleAttributeSet )
 SimpleAttributeSet sattSet = (SimpleAttributeSet)attSet;
 Enumeration atts = sattSet.getAttributeNames();
 Object att;
 while ( atts.hasMoreElements() )
 att = atts.nextElement();
 if ( att.toString().equalsIgnoreCase ( "name" ) )
 name = (String)sattSet.getAttribute ( att );
 // got the name of the attribute
 // Note : useMap is a boolean flag for you to set.
 // Some HTML pages used "map" attributes, others "imgmap" attributes
 if ( useMap )
 if ( name.equalsIgnoreCase ( "map" ) )
 imagemap = true;
 else
 if ( name.equalsIgnoreCase ( "imgmap" ) )
 imagemap = true;
 if ( att.toString().equalsIgnoreCase ( "src" ) )
 src = (String)sattSet.getAttribute ( att );
 if ( imagemap )
 try
 imagemapURL = new URL ( src );
 catch ( MalformedURLException malEx )
 System.out.println ("Invalid Image Map URL : " + src );
 public void handleEndTag ( HTML.Tag t, int pos )
}

Live view doesn't correctly pass URL parameters from HTML docs?

Running into something that I wonder if anyone else has seen. I've created a site in DW CS5 with a local testing server (XAMPP on Win7), and if I use LiveView to view an HTML page that has a link to a PHP page that includes a URL parameter, the parameter shows up in the LiveView address bar, but the page doesn't seem to use it (trying to display an image where the file is built using $_GET to retrieve the parameter). The same HTML page, displayed in a browser, works. And if I then save the HTML page as a PHP page in DW, identical code, LiveView works. Sure looks like LiveView will does not properly handle URL parameters from HTML documents...

Sorry if I wasn't clear... the navigation works correctly; I get to the page I'm tyring to get to. One of the things that page should do is display an image, the I use a URL parameter to build the image file name to retrieve. The link in the first page is something like <a href="gallery.php?pg=1">. Works fine if the first page (the one I'm navigating from) is a PHP page, doesn't work (with the same code which is only HTML) if the page is an HTML page.

Extracting an image from WebBrowser

I want to extract an image from WebBrowser and I don't want to download it because some server don’t let download to non-browsers.
Does method for this operation?

First of all you need to get the image url. To retrieve this you can use Regex, or HTMLAgilityPack or etc.
than you can download it from the url of the image as:
public static void DownloadImageWithWebclient(string url)
try
string filename = System.IO.Path.GetFileName(new Uri(url).LocalPath);
var _client = new WebClient();
_client.DownloadFileAsync(new Uri(url), filename);
catch
There are many alternative ways of downloading such as non async.
Also, you can set webclient headers and useragent to responde to the target website as a browser in order to avoid being blocked your request.

How to extract HTML page from the internet

i am new to java, i wish to know how to extract Html page from the internet and also how to identify the differences between the images and text information?

You can create a java.net.URL that points to the file you want to "extract" and read the HTML code (or what ever that file contains) from there using the inputstream given by URL.openStream().
The difference between images and text... well, images are embedded in html using the img-tag. example: <IMG src="http://forum.java.sun.com/images/reply.gif" alt="Reply">. Attributes width, height, alt are sometimes left out and there may or may not be quotes around the values and everything is case insensitive... you'll be having hard time trying to parse the input so I'd suggest using existing parsers.
What are you trying to do anyway? You can load a URL directly to a JTextEditorPane with the setPage(URL page) method...

How to use automator to extract specific text from json txt file

I'm trying to set up an Automator folder action to extract certain data from json files. I'm pulling metadata from YouTube videos, and I want to extract the Title of the video, the URL for the video, and the date uploaded.
Sample json data excerpts:
"upload_date": "20130319"
"title": "[title of varying length]"
"webpage_url": "https://www.youtube.com/watch?v=[video id]"
Based on this thread, seems I should be able to have Automator (or any means of using a shell script) find data and extract it into a .txt file, which I can then open as a space delimited file in Excel or Numbers. That answer assumes a static number of digits for the text to be extracted, though. Is there a way Automator can search through the json file and extract the text - however long - after "title" and "webpage_url"?
json files are all in the same folder, and all end in .info.json.
Any help greatly appreciated!

Hello
You might try the following perl script, which will process every *.json file in current directory and yield out.csv.
* CSV currently uses space for field separator as you requested. Note that Numbers.app cannot import such CSV file correctly.
#!/bin/bash
/usr/bin/perl -CSDA -w <<'EOF' - *.json > out.csv
use strict;
use JSON::Syck;
$JSON::Syck::ImplicitUnicode = 1;
# json node paths to extract
my @paths = ('/upload_date', '/title', '/webpage_url');
for (@ARGV) {
 my $json;
 open(IN, "<", $_) or die "$!";
 local $/;
 $json = <IN>;
 close IN;
 my $data = JSON::Syck::Load($json) or next;
 my @values = map { &json_node_at_path($data, $_) } @paths;
 # output CSV spec
 # - field separator = SPACE
 # - record separator = LF
 # - every field is quoted
 local $, = qq( );
 local $\ = qq(\n);
 print map { s/"/""/og; q(").$_.q("); } @values;
sub json_node_at_path ($$) {
 # $ : (reference) json object
 # $ : (string) node path
 # E.g. Given node path = '/abc/0/def', it returns either
 # $obj->{'abc'}->[0]->{'def'} if $obj->{'abc'} is ARRAY; or
 # $obj->{'abc'}->{'0'}->{'def'} if $obj->{'abc'} is HASH.
 my ($obj, $path) = @_;
 my $r = $obj;
 for ( map { /(^.+$)/ } split /\//, $path ) {
 if ( /^[0-9]+$/ && ref($r) eq 'ARRAY' ) {
 $r = $r->[$_];
 else {
 $r = $r->{$_};
 return $r;
EOF
For Automator workflow, you may use Run Shell Script action as follows, which will receive json files and yield out_YYYY-MM-DD_HHMMSS.csv on desktop.
Run Shell Script action
 - Shell = /bin/bash
 - Pass input = as arguments
 - Code = as follows
#!/bin/bash
/usr/bin/perl -CSDA -w <<'EOF' - "$@" > ~/Desktop/out_"$(date '+%F_%H%M%S')".csv
use strict;
use JSON::Syck;
$JSON::Syck::ImplicitUnicode = 1;
# json node paths to extract
my @paths = ('/upload_date', '/title', '/webpage_url');
for (@ARGV) {
 my $json;
 open(IN, "<", $_) or die "$!";
 local $/;
 $json = <IN>;
 close IN;
 my $data = JSON::Syck::Load($json) or next;
 my @values = map { &json_node_at_path($data, $_) } @paths;
 # output CSV spec
 # - field separator = SPACE
 # - record separator = LF
 # - every field is quoted
 local $, = qq( );
 local $\ = qq(\n);
 print map { s/"/""/og; q(").$_.q("); } @values;
sub json_node_at_path ($$) {
 # $ : (reference) json object
 # $ : (string) node path
 # E.g. Given node path = '/abc/0/def', it returns either
 # $obj->{'abc'}->[0]->{'def'} if $obj->{'abc'} is ARRAY; or
 # $obj->{'abc'}->{'0'}->{'def'} if $obj->{'abc'} is HASH.
 my ($obj, $path) = @_;
 my $r = $obj;
 for ( map { /(^.+$)/ } split /\//, $path ) {
 if ( /^[0-9]+$/ && ref($r) eq 'ARRAY' ) {
 $r = $r->[$_];
 else {
 $r = $r->{$_};
 return $r;
EOF
Tested under OS X 10.6.8.
Hope this may help,
H

Unable to extract the data from ECC 6.0 to PSA

Hello,
I'm trying to extract the data from ECC 6.0 data source name as 2LIS_11_VAHDR into BI 7.0
When i try to load Full Load into PSA , I'm getting following error message
Error Message: "DataSource 2LIS_11_VAHDR must be activated"
Actually the data source already active , I look at the datasource using T-code LBWE it is active.
In BI on datasource(2LIS_11_VAHDR) when i right click selected "Manage" system is giving throughing below error message
"Invalid DataStore object name /BIC/B0000043: Reason: No valid entry in table RSTS"
If anybody faced this error message please advise what i'm doing wrong?
Advance thanks

ECC 6.0 side
Delete the setup tables
Fill the data into setup tables
Schedule the job
I can see the data using RSA3 (2LIS_11_VAHDR) 1000 records
BI7.0(Service Pack 15)
Replicate the datasource in Production in Backgroud
Migrate Datasource 3.5 to 7.0 in Development
I did't migrate 3.5 to 7.0 in Production it's not allowing
When i try to schedule the InfoPakage it's giving error message "Data Source is not active"
I'm sure this problem relate to Data Source 3.5 to 7.0 convertion problem in production. In Development there is no problem because manually i convert the datasource 3.5 to 7.0
Thanks

Unable to open URL attachment from SBWP in CRM WEB UI

Hello Gurus,
Need your help please. I'm having some problem opening the URL attachment from SBWP via CRM 7 WEB UI (I used a Transaction Launcher for SBWP). The attachment is a Webdynpro application. I am able to open the attachment in SAP GUI, but not in CRM WEBUI. This problem occured when we update the SP level of CRM 7.
Here's the scenario,
- whenever I click the attachment, it open a new window, which also happen even before SP level update, with the following information:
Execute an Application on FrontEnd
Please wait. You will be forwarded automatically.
This page is included for technical reason.
Execute program.
Status: Displaying Office Document ..........
After a couple of seconds, it will return to the Workflow Workplace screen.
I have checked the workflow log and found no inconsistency on the attached URL.
Immediate response would be highly appreciated. Thanks in advance.
Regards,
Edwin

Thanks for the reply WD ABAP.
Yes, I did try to use the functionality of Worklist and the URL attachment successfully opened. However, there are some limitation in its functionality as indicated in the link below that opted us to use the SBWP in CRM WEB UI via transaction launcher.
http://wiki.sdn.sap.com/wiki/display/CRM/CRMWorklist-AdvancewithDialognotSupported
We don't want to adjust the logic of our existing workflow at this point as described in the above link as it will entails end-to-end testing again. We just encountered this issue when we update the SP level of CRM 7.
Hope there is an alternative solution without shifting us to Worklist.
Regards,
Edwin

I am trying to use photomerge compose. I open one standard jpeg image and one image that is my business logo in a png format. When I select the png image, to extract the logo from it, it appears as all white and will not allow me to select the logo from

I am trying to use photomerge compose. I open one standard jpeg image and one image that is my business logo in a png format. When I select the png image, to extract the logo from it, it appears as all white and will not allow me to select the logo from it. It has worked in the past but I downloaded the update today and photomerge will not work correctly. Any ideas?

hedger,
How do you expect anyone to help when we don't know a darned thing about the file, abut your setup, exact version of Photoshop and your OS, machine specs, etc.?
BOILERPLATE TEXT:
Note that this is boilerplate text.
If you give complete and detailed information about your setup and the issue at hand,
such as your platform (Mac or Win),
exact versions of your OS, of Photoshop (not just "CS6", but something like CS6v.13.0.6) and of Bridge,
your settings in Photoshop > Preference > Performance
the type of file you were working on,
machine specs, such as total installed RAM, scratch file HDs, total available HD space, video card specs, including total VRAM installed,
what troubleshooting steps you have taken so far,
what error message(s) you receive,
if having issues opening raw files also the exact camera make and model that generated them,
if you're having printing issues, indicate the exact make and model of your printer, paper size, image dimensions in pixels (so many pixels wide by so many pixels high). if going through a RIP, specify that too.
etc.,
someone may be able to help you (not necessarily this poster, who is not a Windows user).
a screen shot of your settings or of the image could be very helpful too.
Please read this FAQ for advice on how to ask your questions correctly for quicker and better answers:
http://forums.adobe.com/thread/419981?tstart=0
Thanks!

Php extract url's from recordset

Similar Messages

Maybe you are looking for