Using network data to detect DPI

"Network transparency cuts both ways. It can be exploited to engage in surveillance of Internet service providers as well as Internet users. In order to better understand DPI use and the scope of its deployment, the project makes use of crowdsourced network monitoring data. So far, we have used data from a test known as Glasnost, which was developed by German researchers to detect blocking or throttling of BitTorrent and other peer to peer (P2P) file sharing protocols. The detailed workings of the Glasnost test are described in Dischinger, Marcon, et al (2010)."
using network data to detect dpi
Use tools running on M-Lab to test your Internet connection.

John the point being that DPI would need to be used based on what the post says to keep it unthrottled.
It's DPI that is the privacy concern not throtteling so BT's use of DPI which may be increasing is a concern not least since they have been known to run 'tests' of dubious legality before now (Phorm or some such as I recall)
If my post was helpful then please click on the Ratings star on the left-hand side If the the reply answers your question fully then please select ’Mark as Accepted Solution’

Similar Messages

  • XML Parse issues when using Network Data Model LOD with Springframework 3

    Hello,
    I am having issues with using using NDM in conjuction with Spring 3. The problem is that there is a dependency on the ConfigManager class in that it has to use Oracle's xml parser from xmlparserv2.jar, and this parser seems to have a history of problems with parsing Spring schemas.
    My setup is as follows:
    Spring Version: 3.0.1
    Oracle: 11GR2 and corresponding spatial libraries
    Note that when using the xerces parser, there is no issue here. It only while using Oracle's specific parser which appears to be hard-coded into the ConfigManager. Spring fortunately offers a workaround, where I can force it to use a specific parser when loading the spring configuration as follows:
    -Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl But this is an extra deployment task we'd rather not have. Note that this issue has been brought up before in relation to OC4J. See the following link:
    How to change the defaut xmlparser on OC4J Standalone 10.1.3.4 for Spring 3
    My question is, is there any other way to configure LOD where it won't have the dependency on the oracle parser?
    Also, fyi, here is the exception that is occurring as well as the header for my spring file.
    org.springframework.beans.factory.xml.XmlBeanDefinitionStoreException:
    Line 11 in XML document from URL [file:/C:/projects/lrs_network_domain/service/target/classes/META-INF/spring.xml] is invalid;
    nested exception is oracle.xml.parser.schema.XSDException: Duplicated definition for: 'identifiedType'
         at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:396)
         [snip]
         ... 31 more
    Caused by: oracle.xml.parser.schema.XSDException: Duplicated definition for: 'identifiedType'
         at oracle.xml.parser.v2.XMLError.flushErrorHandler(XMLError.java:425)
         at oracle.xml.parser.v2.XMLError.flushErrors1(XMLError.java:287)
         at oracle.xml.parser.v2.NonValidatingParser.parseDocument(NonValidatingParser.java:331)
         at oracle.xml.parser.v2.XMLParser.parse(XMLParser.java:222)
         at oracle.xml.jaxp.JXDocumentBuilder.parse(JXDocumentBuilder.java:155)
         at org.springframework.beans.factory.xml.DefaultDocumentLoader.loadDocument(DefaultDocumentLoader.java:75)
         at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:388)Here is my the header for my spring configuration file:
    <?xml version="1.0" encoding="UTF-8"?>
    <beans xmlns="http://www.springframework.org/schema/beans"
           xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
           xmlns:aop="http://www.springframework.org/schema/aop"
           xmlns:tx="http://www.springframework.org/schema/tx"
           xmlns:context="http://www.springframework.org/schema/context"
           xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
           http://www.springframework.org/schema/aop http://www.springframework.org/schema/aop/spring-aop.xsd
           http://www.springframework.org/schema/tx http://www.springframework.org/schema/tx/spring-tx.xsd
           http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context.xsd">Thanks, Tom

    I ran into this exact issue while trying to get hibernate and spring working with an oracle XMLType column, and found a better solution than to use JVM arguments as you mentioned.
    Why is it happening?
    The xmlparserv2.jar uses the JAR Services API (Service Provider Mechanism) to change the default javax.xml classes used for the SAXParserFactory, DocumentBuilderFactory and TransformerFactory.
    How did it happen?
    The javax.xml.parsers.FactoryFinder looks for custom implementations by checking for, in this order, environment variables, %JAVA_HOME%/lib/jaxp.properties, then for config files under META-INF/services on the classpath, before using the default implementations included with the JDK (com.sun.org.*).
    Inside xmlparserv2.jar exists a META-INF/services directory, which the javax.xml.parsers.FactoryFinder class picks up and uses:
    META-INF/services/javax.xml.parsers.DocumentBuilderFactory (which defines oracle.xml.jaxp.JXDocumentBuilderFactory as the default)
    META-INF/services/javax.xml.parsers.SAXParserFactory (which defines oracle.xml.jaxp.JXSAXParserFactory as the default)
    META-INF/services/javax.xml.transform.TransformerFactory (which defines oracle.xml.jaxp.JXSAXTransformerFactory as the default)
    Solution?
    Switch all 3 back, otherwise you'll see weird errors.  javax.xml.parsers.* fix the visible errors, while the javax.xml.transform.* fixes more subtle XML parsing (in my case, with apache commons configuration reading/writing).
    QUICK SOLUTION to solve the application server startup errors:
    JVM Arguments (not great)
    To override the changes made by xmlparserv2.jar, add the following JVM properties to your application server startup arguments.  The java.xml.parsers.FactoryFinder logic will check environment variables first.
    -Djavax.xml.parsers.SAXParserFactory=com.sun.org.apache.xerces.internal.jaxp.SAXParserFactoryImpl -Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl -Djavax.xml.transform.TransformerFactory=com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl
    However, if you run test cases using @RunWith(SpringJUnit4ClassRunner.class) or similar, you will still experience the error.
    BETTER SOLUTION to the application server startup errors AND test case errors:
    Option 1: Use JVM arguments for the app server and @BeforeClass statements for your test cases.
    System.setProperty("javax.xml.parsers.DocumentBuilderFactory","com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl");
    System.setProperty("javax.xml.parsers.SAXParserFactory","com.sun.org.apache.xerces.internal.jaxp.SAXParserFactoryImpl");
    System.setProperty("javax.xml.transform.TransformerFactory","com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl");
    If you have a lot of test cases, this becomes painful.
    Option 2: Create your own Service Provider definition files in the compile/runtime classpath for your project, which will override those included in xmlparserv2.jar.
    In a maven spring project, override the xmlparserv2.jar settings by creating the following files in the %PROJECT_HOME%/src/main/resources directory:
    %PROJECT_HOME%/src/main/resources/META-INF/services/javax.xml.parsers.DocumentBuilderFactory (which defines com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl as the default)
    %PROJECT_HOME%/src/main/resources/META-INF/services/javax.xml.parsers.SAXParserFactory (which defines com.sun.org.apache.xerces.internal.jaxp.SAXParserFactoryImpl as the default)
    %PROJECT_HOME%/src/main/resources/META-INF/services/javax.xml.transform.TransformerFactory (which defines com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl as the default)
    These files are referenced by both the application server (no JVM arguments required), and solves any unit test issues without requiring any code changes.
    This is a snippet of my longer solution for how to get hibernate and spring to work with an oracle XMLType column, found on stackoverflow.

  • HT5848 i'm hooked up to a wifi network but i cannot access itunes radio without using cellular data, why?

    I'm trying to use the new iTunes radio but it keeps telling me "Network Unavailable, Connect to Wi-Fi network or use cellular data". Problem is, I am hooked up to a Wi-Fi network. I went to settings--> Wi-Fi--> and it is one and connected. How can I get iTunes radio to recognze this?
    Thank you

    After I did a hard reset I was able to see the radio. Now, a few moments later, the radio has dissapeared from my music all together. I just turned my phone off and back on again in hopes that it would reappear but it did not. I then tried to do another hard reboot butthat did not work either. I have lost it altogether.

  • Can you use the data while NOT on the EDGE network?

    I am wondering if when I travel through SD and ND I will be able to use my data (email, web, maps...etc.) I am in Minneapolis on the EDGE network, but I'm concerned that in Sioux Falls, SD no a GPRS network I won't be able to use 1/2 the functions on my phone.
    Before release the rumor was that it would work, but has anyone actually tried it yet?

    So essentially you're asking... if there's no Wi-Fi or EDGE coverage will you be able to use the data network features of the phone?
    In short... from my experience the answer appears to be "no, it won't work." Allow me to elaborate:
    I disabled Wi-Fi access and found an EDGE dead spot where the phone could not connect to the EDGE data network but I could place a phone call. When I attempted to launch Mail and sync, I got a message saying that my IMAP server could not be reached. When attempted to launch a website, I received an error message stating that the server could not be reached.
    End result, I was unable to use any of the data network features of the phone. So it would appear... that the answer is no. It will not use the basic GPRS undearlining network. However it's quite possible that your results may vary.

  • IPhone 4S uses 3G data even with WiFi network available

    I've been trying to figure out why the iPhone still uses 3G data even when it has a WiFi network available. It's usually just a few MBs per day, and as such - I attributed to niotifications, location services, etc.
    But today, I got a really nasty surprise...
    As I woke up, my iPhone showed the WiFi indicator as usual, but internet was slow... as if it was using cellular data. Something i quickly confirmed by trying to access  stuff on my internal LAN and not being able to.
    Worst of all, my iPhone went through over 600MB of cellular data overnight - that's my entire data limit for a month! - meaning I'll have to pay for neary 400MB of excess data usage paid at overly inflated prices (I'll be paying nearly 3x my monthly bill just for the excess data!!!)
    As if all the bugs I've been facing weren't enough: Invalid SIM, showing full strength 3G signal when it's actually "offline"... Now I have to face stupidly wasted mobile data when I'm at home within WiFi range?
    I've been an iPhone use for years, and have upgraded every year to the new models... but this iPhone 4S has been my worst experience ever with a mobile device, and ruined all the trust I had in Apple devices...
    I sincerely don't know what to do next... if I'll still wait for a 5.1 update that may/may not fix all the issues I (and thousands others, as seen by the discussions here) have been having... or if I cut my losses and try my luck elsewhere...
    Tired of serving as a guinea pig and doing all this debug work for Apple...

    The WiFi data is recorded separately - and the mobile data use was verified using the operator "reporting" service (and later sending me the warning SMS of the data use).
    The iPhone was in the home screen, locked, and "sleeping" when the data was used, so the only option would be the iCloud backup - which, in any case, should never ever use the 3G data (and never has until today).
    If the WiFi was not working, then it should either: not have internet access; not show the WiFi connected signal in the status bar. As it was, it was showing WiFi access, but using the mobile data just the same.
    Which, from what I understand, could have "tricked" iCloud into doing its regular backup thinking it was over WiFi... but in reality doing it over cellular data.

  • My network dies when i use cellular data

    Hi guys. I have a problem with my iPhone 4. When I use cellular data, my network die and i have to reset my phone to connect to network again. Anyone experienced this? And i am unable to create personal hotspot.

    my english ***** and i'm sorry for that. i'll try to be more specific.
    i am unable to use 3g, only edge.
    in the moment i activate 3g, my 2g network ( the one i call people and send texts ) dies and instead of operator name in status bar appear Searching... and then No Service. When i stop 3g, my operator is back. i've seen many people with this issue and i'm affraid that my hardware have problems becouse i've just make a complete restore to factory settings and the problem is still there. if anyone know something about this and have a clue, please help . Thank you.

  • IPhone5 with ios 6.1.2 uses cellular data when connected to wifi.  Every hour to the minute even when no apps are running, iCloud is off, Ads are off, Diagnostics are off.  Running on AT&T cellular network.

    I have 3 iPhone5's with ios 6.1.2 that user cellular data when connected to wifi.  Every hour to the minute even when no apps are running, iCloud is off, Ads are off, Diagnostics are off.  Running on AT&T cellular network. 
    Date Time To/From
    Type
    Direction
    Msg/KB
    03/14
    01:30 PM
    phone
    Internet/MEdia Net
    Sent
    78 KB
    03/14
    01:02 PM
    phone
    Internet/MEdia Net
    Sent
    4397 KB
    03/14
    12:48 PM
    phone
    Internet/MEdia Net
    Sent
    19520 KB
    03/14
    12:30 PM
    phone
    Internet/MEdia Net
    Sent
    19503 KB
    03/14
    11:30 AM
    phone
    Internet/MEdia Net
    Sent
    2427 KB
    03/14
    10:30 AM
    phone
    Internet/MEdia Net
    Sent
    359 KB
    03/14
    09:30 AM
    phone
    Internet/MEdia Net
    Sent
    1396 KB
    03/14
    09:25 AM
    phone
    Internet/MEdia Net
    Sent
    1 KB
    03/14
    08:25 AM
    phone
    Internet/MEdia Net
    Sent
    30 KB
    03/14
    07:25 AM
    phone
    Internet/MEdia Net
    Sent
    16 KB
    03/14
    06:25 AM
    phone
    Internet/MEdia Net
    Sent
    45 KB
    03/14
    05:25 AM
    phone
    Internet/MEdia Net
    Sent
    15 KB
    03/14
    04:25 AM
    phone
    Internet/MEdia Net
    Sent
    14 KB
    03/14
    03:25 AM
    phone
    Internet/MEdia Net
    Sent
    21 KB
    03/14
    02:25 AM
    phone
    Internet/MEdia Net
    Sent
    23 KB
    03/14
    01:25 AM
    phone
    Internet/MEdia Net
    Sent
    16 KB
    03/14
    12:25 AM
    phone
    Internet/MEdia Net
    Sent
    23 KB

    Hello All Who Read This!
    I just bought an iPhone 5 on the 21st of March. I ate through 850 MB's in 12 days. I read up on the issue of data consumption looking for tips to conserve data. I did not know there was a problem.
    This morning I found out that I was leaking data very little, but daily it accumulates. I am in Barcelona, Spain. I do not have a contract, I am on a prepaid Yoigo carrier.
    I happened upon an article/blog by Robert Parks at snnyc.com "problems persist in ios 6.1.2.".
    Although his situation did not relate to me, I tried a few tests on my own to see if I could stop the data leak without turning off my celular data and possibly push notifications, I think I found a solution that might help someone:
    In ios 6.1.3 goto Settings/Mail, Contacts,Calenders and scroll down to Calendars and turn off " New Invitation Alerts" and also turn off "Shared Calendar Alerts".
    My Cellular Network Data seems to be behaving. I only see a change in MB used when I open an ap that uses data.
    All The Best

  • How to use NetworkConstraint in Network Data Model?

    e.g. In a transportation application, you may drive from Node1 to Node2 along Link12, and from Node2 to Node4 along Link24, but you can not 'turn-left' from Link12 to Link24, how to restrict this in Oracle Spatial Network Data Model?
    Is there any examples?
    Thanks a lot.

    The only way I know to do it, is to have a more complex node model. Instead of a simple node joining links 12 and 24, you need several at that point that link the streets. For example, with a standard four-way intersection, each end of the streets would have a node (warning CRUDE drawing):
    ..A
    B.+.C
    ..D
    Links between those nodes could have directional restrictions, or not even exist at all between any two. So, you could set it up such that From D to A and B to C you can go either way. For right turns, D to C, C to A, A to B, and B to D are directional. For left turns, C to D, A to C, and B to A are directional, with no D to B link existing.
    Hope that makes sense.

  • DTP Error: Duplicate data record detected

    Hi experts,
    I have a problem with loading data from DataSource to standart DSO.
    In DS there are master data attr. which have a key  containing id_field.
    In End routine I make some operations which multiple lines in result package and fill new date field - defined in DSO ( and also in result_package definition )
    I.E.
    Result_package before End routine:
    __ Id_field ____ attra1 ____  attr_b  ...___   attr_x ____ date_field
       ____1________ a1______ b1_________ x1         
       ____2________ a2______ b2_________ x2       
    Result_package after End routine:
    __ Id_field ____ attra1 ____  attr_b  ..___   attr_x ____ date_field
       ____1________ a1______ b1_________ x1______d1         
       ____2________ a1______ b1_________ x1______d2    
       ____3________ a2______ b2_________ x2______d1         
       ____4________ a2______ b2_________ x2______d2   
    The  date_field (date type)  is in a key fields in DSO
    When I execute DTP I have an error in section Update to DataStore Object: "Duplicate data record detected "
    "During loading, there was a key violation. You tried to save more than one data record with the same semantic key."
    As I know the result_package key contains all fields except fields type i, p, f.
    In simulate mode (debuging) everything is correct and the status is green.
    In DSO I have uncheched checkbox "Unique Data Records"
    Any ideas?
    Thanks in advance.
    MG

    Hi,
          In the end routine, try giving
    DELETE ADJACENT DUPLICATES FROM RESULT_PACKAGE COMPARING  XXX  YYY.
    Here XXX and YYY are keys so that you can eliminate the extra duplicate record.
    Or you can even try giving
        SORT itab_XXX BY field1 field2  field3 ASCENDING.
        DELETE ADJACENT DUPLICATES FROM itab_XXX COMPARING field1 field2  field3.
    this can be given before you loop your internal table (in case you are using internal table and loops)  itab_xxx is the internal table.
    field1, field2 and field 3 may vary depending on your requirement.
    By using the above lines, you can get rid of duplicates coming through the end routine.
    Regards
    Sunil
    Edited by: Sunny84 on Aug 7, 2009 1:13 PM

  • FMS 3.5 says 'Bad network data': error in handling RTMP extended timestamps / chunkSize?

    Hello all,
    For a client, I am working on a project where a live RTMP stream is published to an Adobe FMS 3.5.6 server from a java application, using Red5 0.9.1 RTMPClient code.
    This works fine, until the timestamp becomes higher than 0xFFFFFF after 4.6 hours, and the RTMP extended timestamp field starts being used. I have already found: when the extended timestamp was written after the header, the last 4 bytes of the data were being cut off. I have fixed this locally, and now the data being sent seems to me to be conformant to the spec. However, FMS still throws an error message in the core log and then kills the connection from the Red5 client. Here is the error message:
    This is the error message:
    2011-06-03     14:28:02     13060     (e)2611029     Bad network data; terminating connection : chunkstream error:message length 11893407 is longerthan max rtmp packet length     -
    2011-06-03     14:28:02     13060     (e)2631029     Bad network data; terminating connection : (Adaptor: _defaultRoot_, VHost: _defaultVHost_, IP: 127.0.0.1, App: live/_definst_, Protocol: rtmp, Client: 5290168480216205379, Handle: 2147942405) : 05 FF FF FF 00 13 = 09 01 00 00 00 01 00 01 01 ' 01 00 00 00 00 00 13 4 09 0 00 00 01 ! 9A & L 0F FA F6 12 , B4 A6 CE H 8A AB DC G BB d k 1B 9F ) 13 13 D2 9A E5 t 8 B8 8D 94 ! 8A AE F6 AF } " U 0 D3 Q EF FF ~ 8D 97 D9 FF BE A3 F3 C9 97 o 9D # F9 7F h A4 F7 } / FB & F1 DC 9C BF   BD D3 E7 CA 97 FE E2 B9 E4 F7 9E 1A F6 BA } C9 w FC _ / / w FE n EF D7 P 9C F4 BE 82 8E F7 | BE 97 B4 BB D7 FE ED I / FB D1 93 9A F9 X \ 85 BD DD I E3 4 E8 M 13 D3 " ) BE A9 92 E5 83 D4 B4 12 DE D5 A3 E6 F4 k DE BF Q 3 A0 g r A4 f D9 BD w * } F7 r 8A S 2 . AB BD EE ^ l f AF E1 0B $ AF 9D D7 - BF E8 ! D3 } D3 i E3 B8 F2 M A8 " B1 A5 EF s ] A5 BC 96 E5 u e X q D2 F1 r F9 i 92 b EE Z d F9 * A6 BB FD 17 w 4 DD 3 o u EB ] ] EF FE B5 B1 0A F2 A0 DD FD B2 98 DF E8 e F6 CB FD 96 V % A5 D5 k ] FD w EF AF k v AA E8 ! 9F / w BE FA 9A _ E F2 D3 , ? 17 } AD 7 EC B3   } 07 B5 | z { { A5 = 11 90 CF BF ; 4 FE EF 95 F7 E7 DF B9 , AF z 91 CF C9 BD DE CB { F5 17 } F2 E5 D7 DF z E6 [ 96 > Y m 9F EB AF DD D8 E8 v B9 A8 E9 % A7 | 1 CF 8B D Z k N DF F8 N FA S R FE . ~ CB A 9 E1 ) 8F 8E BB EC c 6 13 F1 AC FD FD FC 8A F7 F3 K B9 FA ^ / A4 FC B9 AA F6 DE C2 [ 1A E c r B3 BF E5 EC B5 x 94 FD . A9 t I Q % EA EC DE | K FE z A4 97 F9 " 1 0F CA FB F5 F5 p 9E 99 3 - ; B8 F4 F1 FF t A3 EC BC # DE AC 91 13 19 o < 06 F5 FD 7F 7 _ $ D B t B5 0D 8A C1 C1 BA 0B FE DB B7 83 _ } BD z F7 CB { FC M A9 8D = D5 B1 < 85 = EF E1 ; BA H y FC BC B4 C A2 D9 ` e E4 94 H 5 13 ' 93 93 8E E C2 1C R 97 9 X B7 FF 10 9F { ) F1 CF AB AC ] EE H A2 DE D3 C5 m F6 K A2 A7 A2 89 D2 z EB DF 97 ^ k 9E 99 BB E7 B6 97 w { ~ + C7 B2 } FE ' C4 | B6 o H DD r A8 9F DC FF F9 Q b l 93 T B6 EE FF 11 j CD s P C F1 3 R I F8 D8 R 9D 93 AA D5 + DE FC BE " B9 E1 ` CB BD 0F F5 C7 AA w CF 8D p 9A F7 g f N FF 84 B7 K Q 93 g E1 - D3 s } w v AE 96 98 ED CF BA E9 2 . f 99 95 97 o 13 CA F7 s e $ F4 B5 15 C4 A8 DE M F7 w \ 8D 00 C6 C2 b D3 / 7 w F2 ' BF CD 89 FF > D7 FB BC A2 S N FB A5 CD AF D3 F9 9D DF AE B5 17 CF 9D B7 , B9 9 ^ 7F [ 93 84 F7 } _ EA DF u \ 99 Z t E CA M EF 7 " AD FE 92 9E n 7F EB D8 C { 99 8B 9E w H BF B1 | g 9F F3 FA E1 - E5 CB BB x CF p 8B D2 w v EF w FA E2 F7 s C5 AC $ FC B4 DB BE G E4 DC F0 A0 96 F3 ! t DC FF % A5 CB A4 ^ AB D2 BD E7 9A E ' 08 + AF U 17 EB 8A w A7 N E4 A5 x 93 12 _ - ; 09 DD DF m 11 BE w \ } BA D3 t BC D9 97 9B C5 7F D8 H F1 D 7 8A ^ FA n F0 B8 W E6 84 5 - 8 B5 h o C4 F7 83 P 88 CB AE m t BB L 95 A9 s 90 A2 Y o DF K _ / l D2 D1 C9 91 ' E4 BD / / D 97 m BB E7 14 93 % C5 ; DD CF D8 : ~ B5 4 F FA U F0 8F w w DC FD 83 FC 13 EF w p DA A5 07 _ * - 1D 14 9D D5 84 F E6 F0 FF E4 15 w n A5 9F DE d AE F5 " - f D2 AE 96 1F # FA F1 x C1 L DF l M 06 8A E4 z DB 17 BA l DA e 15 CD 85 86 1F 09 82 h ] C6 { E7 C5 AF Z C5 B0 83 v D9 03 FC / ~      -
    The message for which the hex dump is displayed, is a video message of size 4925 bytes. Below is the basic logging in my application:
    *** Event sent to RTMP connector: Video - ts: 16777473 length: 4925. Waiting time: -57937, event timestamp: 16777473
    14:28:02.045 [RtmpPublisher-workerThread] DEBUG o.r.s.s.consumer.ConnectionConsumer - Message timestamp: 16777473
    14:28:02.045 [RtmpPublisher-workerThread] DEBUG o.r.s.n.r.codec.RTMPProtocolEncoder - Channel id: 5
    14:28:02.045 [RtmpPublisher-workerThread] DEBUG o.r.s.n.r.codec.RTMPProtocolEncoder - Last ping time for connection: -1
    14:28:02.045 [RtmpPublisher-workerThread] DEBUG o.r.s.n.r.codec.RTMPProtocolEncoder - Client buffer duration: 0
    14:28:02.046 [RtmpPublisher-workerThread] DEBUG o.r.s.n.r.codec.RTMPProtocolEncoder - Packet timestamp: 16777473; tardiness: -30892; now: 1307104082045; message clock time: 1307104051152, dropLiveFuturefalse
    14:28:02.046 [RtmpPublisher-workerThread] DEBUG o.r.s.n.r.codec.RTMPProtocolEncoder - !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!12b Wrote expanded timestamp field
    14:28:02.046 [NioProcessor-22] DEBUG o.r.server.net.rtmp.BaseRTMPHandler - Message sent
    I have captured the entire frame containing this message with wireshark, and annotated it a bit. You can find it here:
    http://pastebin.com/iVtphPgU
    The video message of 4925 bytes (hex 00 13 3D) is cut up into chunks of 1024 bytes (chunkSize 1024 set by Red5 client and sent to FMS). Indeed, after the 12-byte header and the 4-byte extended timestamp, there are 1024 bytes before the 1-byte header for the next chunk (hex C5). The chunks after that also contain 1024 bytes after the chunk header. This appears correct to me (though please correct me if I'm wrong).
    When we look at the error message in the core log, the hex dump displayed also contains 1024 bytes, but it starts from the beginning of the message header. The last 16 bytes of the message chunk itself are not shown.
    My question is this: is the hex dump in the error message always capped to 1024 bytes, or did FMS really read too little data?
    Something that may be of help, is the reported 'too long' message length 11893407. This corresponds to hex B5 7A 9F, which can also be found in the packet, namely at row 0c60 (I've annotated it as [b5 7a 9f]. This location is exactly 16 bytes after the start of the 4th chunk data, not really a place to look for timestamps.
    My assumptions during this bug hunting session were the following (would be nice if someone could validate these for me):
    - message length, as specified in the RTMP 12 and 8-bit headers, defines the total number of data bytes for the message, NOT including the header of the first message chunk, its extended timestamp field, or the 1-byte headers for subsequent chunks. The behaviour is the same whether or not the message has an extended timestamp.
    - chunk size, as set by the chunkSize message, defines the total number of data bytes for the chunk, not incuding the header or extended timestamp field. The behaviour is the same whether or not the message has an extended timestamp.
    I believe I've chased this problem as far as I can without having access to the FMS 3.5 code, or at least being able to crank up the debug logging to the per-message level. I realize it's a pretty detailed issue and a long shot, but being able to publish a stream continuously 24/7 is critical for the project.
    I would be very grateful if someone could have a look at this hex dump to see if the message itself is correct, and if so, to have a look at how FMS3.5.6 handles this.
    Don't hesitate to ask me for more info if it can help.
    Thanks in advance
    Davy Herben
    Solidity

    Hello,
    It took a bit longer than expected, but I have managed to create a minimal test application that will reproduce the error condition on all machines I've tested on. The application will simply read an H264 file and publish it to an FMS as a live stream. To hit the error condition faster, without having to wait 4.6 hours, the application will add a fixed offset to all timestamps before sending it to the FMS.
    I have created two files:
    http://www.solidity.be/publishtest.jar : Runnable java archive with all libraries built in
    http://www.solidity.be/publishtest.zip : Zip file containing sources and libraries
    You can run the jar as follows:
    java -jar publishtest.jar <inputFile> <server> <port> <application> <stream> <timestampOffset>
    - inputFile: path to an H264 input video file
    - server: hostname or IP of FMS server to publish to
    - port: port number to publish to (1935)
    - application: application to publish to (live)
    - stream: stream to publish to (output)
    - timestampOffset: nr of milliseconds to add to the timestamp of each event, in hexadecimal format. Putting FFFFFF here will cause the server to reject the connection immediately, while FFFF00 or FFF000 will allow the publishing to run for awhile before the FMS kills it
    Example of a complete command line:
    java -jar publishtest.jar /home/myuser/Desktop/movie.mp4 localhost 1935 live output FFF000
    Good luck with the bug hunting. Let me know if there is anything I can help you with.
    Kind regards,
    Davy Herben

  • Why my apps can't be disable on USE CELLULAR DATA FOR under Cellular settings

    I came across an issue that my apps tend to stay on ( enable ) even when I disabled it manually, it will turn back on soon after, this can cause certain people data overage and extra data cost they did not expect. I always check my settings daily because I play with my phone numerous times a day so I noticed any changes or differences. So after I had done probably most people have tried, reset/restart the phone, check any latest OS updates, double check any settings, reset network settings, turn off and on data, turn on and off airplane mode, the conclusion is nothing. So I thought maybe i should try one app that I know kept turning back on when I disabled it, did the updates on the appstore, went back to the settings and I was able to turn on and off, tried the second app just to make sure my  assumption works, updated the newest version on appstore, it works. So I decided to update all of the apps, then the problem is FIXED ! I hope this solve people's issue. Now I am able to manually disable and enable any app under USE CELLULAR DATA FOR,It was lucky guess for me and it work.

    Did you try to reset the phone by holding the sleep and home button for about 10sec, until the Appel logo comes back again? You will not lose data by resetting.
    If this does not work, did you try to switch off Cellular Data, restart the phone and switch it back on again?

  • Error in Release of Network data via BAPI_BUS2002_SET_STATUS

    Hi Experts,
    I have to release network data via a Custom Report Program, so I am using the STD BAPI , BAPI_BUS2002_SET_STATUS.
    The functionality must be similar to the release of Network as in case of transaction CN22 or can also be done via Project Builder(Transaction CJ20N).
    we r using the std BAPI as follows :
    CALL FUNCTION 'BAPI_BUS2002_SET_STATUS'
        EXPORTING
          number                    = < NETWORK NUMBER >
          set_system_status = 'REL'
        IMPORTING
          return             = c_return
        TABLES
          e_result           = lt_result.
    The error  is Error in processing. Function was not executed . On further analysis, the Function Module CO_ZR_HEADER_RELEASE is causing the issue , not allowing network header data to be free.
    The same functionality works via CN22. Please advice whether there is a need to pass further parameters or anything else.
    Awaiting a response..
    Regards,
    Sonika

    Hi,
    there are some special requirements for using this BAPI. You need to call BAPI BAPI_PS_INITIALIZATION and BAPI_PS_PRECOMMIT with this BAPI. Check documentation for your BAPI. It's well documented there.
    Cheers

  • Issue found in EHS in using specification data import using  process

    Dear EHS community
    Now using EHS classic for a long time a issue has been detected in EHS standard import. During maintenance of EHS data normally using CG02 the system is always using the default "Data origin" specified in customizing to be stored in EHS tables (e.g. ESTRH, ESTRI etc.). In standard process to import specification data one can define a different "Data origin". Now we are using an import file with default" data origin and executed the import. Now a strange effect has been detected (and not always) for update of identifiers. For the import purpose you must nominate at least one identifier. If the identifier is found then normally no update happens but only the value assignment data is inserted (or updated). If the identifier is not found it get be inserted on spec level in ESTRI. Now during the update the "Data origin" of the identifier present in the system (and which matched to identifier on file level) was changed but not the identifier as such. Any data record on value assignment level received the defautl data origin. Actually there is no explanation for this behaviour. If Default "Data origin" would be "SAP" (as the term) this value has been change to "Space". Any explanation of this effect is appreciated (or and idea regarding that).
    C.B.
    PS: analysis of change logs in EHS etc. executed so far clearly indictae that an "Update" happened on the identifier; but only the field SRSID is effected; EHS import is quite old and therefore very stable;
    PPS: I found a thread taking about the import file:
    spec import_inheritance data
    Example shown thre is like:
    +BS
    +BV   $ESTRH
    SRSID                          EH&S
    SUBID                          000000385000
    SUBCAT                         REAL_SUB
    AUTHGRP                        EHS_PS
    +EV
    +BV   $ESTRI
    SRSID                          EH&S
    IDTYPE                         NAM
    IDCAT                          EHS_OLD
    IDENT                          XY0002
    ORD                            0001
    +EV
    +BV   SAP_EHS_1013_001
    $ESTVA-SRSID                   EH&S
    SAP_EHS_1013_001_VALUE         N09.00101280
    +EV
    If you compare SAP helpt normally only at the"begining pof the file you will find "SRSID" Here this field is nominated often. On Level of ESTRH as well as ESTRI.
    PPS: e.g. refer to: TCG56 EHS: Data Origin - SAP Table - ABAP

    Dear Ralph
    first thanks for feedback. Regarding content provider: we need to check that on deeper level
    Regarding import may be my explanation was not good enough.
    Imagine this case:
    you have a specification in the system there you would like to add e.g. denisity data.. To do so you need at least one identifier which you must nominate during the import. As long as this identifier is "identical" in system and in the file this identifier should not be "changed/effected" etc. and only the additional data should be loaded, This was the process we used. Now we detected that this seems not to be the real effect. The identifier as part of the file is "updated" in EH&S. In the example above somebody used this logic:
    +BV   $ESTRI
    SRSID                          EH&S
    IDTYPE                         NAM
    IDCAT                          EHS_OLD
    IDENT                          XY0002
    ORD                            0001
    +EV
    Nearly the same is used in our process. Only difference ist, that we do not define the "SRSID". The same is true for any other data in the file. SRSID is nether specified.
    What is happing now:
    e.g. the "density" data is added with SRSID "EH&S". This effect is "normal". As by default SRSID should be EH&S (as this is defined as such in customizing) and because of the fact that at the top the ID is es well "EH&S". In the system we have the "XY0002" having SRSID EH&S. By using now this upload approach the only difference afterwards is tht kin th systeM; XY0002 does get "blank" as SRSID (and there is no data origin "blank" defined. Up to today my unertsanding was clearly: no update should happen in the identifier. This seems not to be the case. Is my understanding here different? Or is this SRSID in the load file is really mandatory in ESTRI level to avoid this effect. I hope that you can provide some feedback regarding this.
    C.B.
    PS: referring to: Example: Transfer File for Specifications - Basic Data and Tools (EHS-BD) - SAP Library
    The header of import file should look like:
    Comment
    +C
    Administrative section
    Character standard
    +SC
    ISO-R/3
    Identification (database name)
    +ID
    IUCLID
    Format version
    +V
    2.21
    Export date
    +D
    19960304
    Key date for export
    +VD
    19960304
    Set languages for export
    +SL
    E
    Date format
    +DF
    DD.MM.YYYY
    IN our case +ID = EH&S (as this is the value in export file)
    IN this example this additional one is shown:
    Begin table
    +BV
    $ESTRI
      Table field
    IDTYPE
    NAM
      Table field
    IDCAT
    IUPAC
      Table field
    IDENT
    anisole
      Table field
    LANGU
    E
      Table field
    OWNID
    ID1
    Therefore no SRSID is specified. And this is the data in our file (on high level) and the "only" change is that the identifer get "deleted" the SRSID

  • IPad 2 chooses to use Cellular data instead of Wi-Fi (This is Sh*t!)

    Just learned today, the hard way, that for some reason the iPad 2 in it's eternal wishdom chooses to use Cellular data (3G) over Wi-Fi while both are available!
    If the iPad 2 is not smart enough or can not be made smart enough to strongly choose Wi-Fi over Cellular data (3G) at the very least an option should be added under Wi-Fi settings as well as Cellular data settings to allow the user to select it's preferrence.
    I was stunned to learn today while downloading several Gb(s) of data that the iPad while having both available, that is Cellular data (3G) and Wi-Fi, it choose to use Cellular data (3G) and burn right through the $25 AT&T data plan for the month.
    To speak with Steve Jobs: "This is sh*t!"
    I hate to say it, but the Nokia phones resolve this better. They at least have an option that allows the user to choose so it defaults to Wi-Fi when available.

    Yes, I found out about this issue after receiving a warning notice from ATT about data plan running out on my wife's ipad, even though it never left the house, and was always connected to our AP home network. Here is the link to my thread...
    http://discussions.apple.com/message.jspa?messageID=11636856#11636856
    Since then, I have heard from both Apple and ATT (actually both called my cell). Neither one has an explanation, but they expressed concern about both claimed they are "looking into to this issue further". I suspect this is a wildfire about to run out of control for AT&T, given the abandonment of their unlimited plans. My suspicion is that some of this data lead is occurring in the middle of the night, with apple tapping into the logs.

  • Iphone 5s Data Consumption... is it Facebook...is it using cell data when on wifi?

    I recently purchased a new I-phone 5s for my wife.  Since receiving the phone our data usage has gone up exponentially.  We used to have a 2GB plan and never went over, this month we've already gone over our new 4GB limit and still have 9 days left on the cycle.  So obviously I've been trying to figure out what is causing this new and dramatic upswing in data usage.  Our phone habits have not changed, she had an android smart phone before and used it just as much as the new I-phone.  Here's my top 2 suspects.
    1. Facebook  -  Under settings -> Cellular at the very bottom is a list of apps that you can grant or deny permission to use cellular data.  Under each app is the amount of cellular data that has been used by that app.  As you can see in this picture Facebook has used 4.9 GB, an insanely high amount.  I just read an article on the web that describes a feature of the Facebook app which preloads video so that they play more smoothly... every single video you come across whether you watch it or not is being downloaded.  There is a way to turn this off.  Under Settings find the Facebook app, open it and click Settings again.  Turn "Auto-play" to wi-fi only or just turn it off.
    2. Cellular Data being used even when phone is connected to Wi-fi -
         Google it and you will find dozens of articles.  This is not speculation.  Apple has recognized it and calls it a glitch.  Verizon has apparently stated that customers affected by this glitch will not be billed for excess data consumption.  This was reported as far back as 2012 and Apple apparently put out a fix.  I can't say for certain my wife's phone has been using cell data while on wi-fi, but I suspect it may be.  My wife is home most of the time, she's a Nursing student, recently graduated, and so is usually at home studying and should be on the wi-fi network.  Yet her phone consumes 6 to 10 times more data than mine and I'm out of the house most of the time.  If this is true I haven't found a fix for it.  If anyone has I'd like to hear about it.

    It looks like it 4.9 GB on the cellular data. Turn it off in the same screen of which you posted to prevent further data usage.

Maybe you are looking for

  • Template page not rendering in design

    I cannot get template.jsp to render the graphics. I have restarted JDeveloper several times with no luck. Does anyone know another way to force the rendering in design of the graphics? Is there a configuration change I can make? Thanks.

  • Tutorial Error

    Hi all. Got this code in a tutorial. Any help would be grateful. The Code: import java.applet.Applet; import java.awt.BorderLayout; import java.awt.Frame; import java.awt.event.*; import java.awt.GraphicsConfiguration; import com.sun.j3d.utils.applet

  • ISR VS Processes and Forms

    Hey guys, i have a few questions.. I have been developing an ISR for a little while now but i keep running into issues with the fact that it does not seem to be very complete compared to Processes and Forms. It also seems that nobody really knows ISR

  • 11g Select outcome

    I'm not sure if this is actually an ADF question but here goes: I want to select an outcome value from a drop down list instead of having lots of buttons. My normal 'outcome' button looks like this: <af:commandToolbarButton actionListener="#{invokeAc

  • How can I get my library back o my new mac?

    I have a new MacBook Pro and I dont have my library beacause my other Mac Pro is broken.HOW CAN I GET MY MUSIC LIBRARY BACK?!!!!!