Does WURFL make use of the IAB/ABC International Spiders & Bots List to identify bots?
Here are some example of devices and user-agents that WURFL seems to classify wrongly.
device_type, user_agent
-----
apple-iphone,Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
apple-iphone,Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; http://www.bing.com/bingbot.htm)
genericwebbrowser,Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; CrystalSemanticsBot http://www.crystalsemantics.com/service ... useragent/)
IAB/ABC International Spiders & Bots List
Re: IAB/ABC International Spiders & Bots List
Hello,
Thank you for letting us know. I will pass these User Agents to our device detection team and will let you know as soon as a fix is available.
Thank you,
Elliot
Thank you for letting us know. I will pass these User Agents to our device detection team and will let you know as soon as a fix is available.
Thank you,
Elliot
Re: IAB/ABC International Spiders & Bots List
Thanks - Those are only a few of the user-agents, we see several more.
Do you use the latest IAB/ABC International Spiders & Bots List to identify bots? If not, can you include that in the API?
Do you use the latest IAB/ABC International Spiders & Bots List to identify bots? If not, can you include that in the API?
Re: IAB/ABC International Spiders & Bots List
Hello,
The `is_robot` virtual capability currently looks at several HTTP headers to determine bot traffic, since the User Agent alone can sometimes be deceiving for some bot traffic. I will have to check with the data analytics team in regards to the inclusion of the IAB Spiders & Bots list and will also let you know the response.
In the meantime, would you mind providing any other User Agents that you are having difficulty detecting?
Thank you,
Elliot
The `is_robot` virtual capability currently looks at several HTTP headers to determine bot traffic, since the User Agent alone can sometimes be deceiving for some bot traffic. I will have to check with the data analytics team in regards to the inclusion of the IAB Spiders & Bots list and will also let you know the response.
In the meantime, would you mind providing any other User Agents that you are having difficulty detecting?
Thank you,
Elliot
Re: IAB/ABC International Spiders & Bots List
Hello,
While these User Agents will return the ID of the device, they should return true for `is_robot`. Are you able to confirm whether or not this is the case for you as well?
Thank you,
Elliot
While these User Agents will return the ID of the device, they should return true for `is_robot`. Are you able to confirm whether or not this is the case for you as well?
Thank you,
Elliot
-
- Posts: 1
- Joined: Mon Sep 07, 2015 2:13 am
-
- Posts: 1
- Joined: Tue Jun 06, 2017 3:55 am
Re: IAB/ABC International Spiders & Bots List
Hi,
any information about the IAB list being included or not?
And could you also elaborate a little more about the way bots are identified in WURFL currently?
I cannot find any precise Information on that..
Thanks!
any information about the IAB list being included or not?
And could you also elaborate a little more about the way bots are identified in WURFL currently?
I cannot find any precise Information on that..
Thanks!
Re: IAB/ABC International Spiders & Bots List
Any luck here? Could anyone please let me know does WURFL identify bots and is in compliance with IAB/ABC international .johannes.kunze@gfk.com wrote: ↑Tue Jun 06, 2017 3:57 amHi,
any information about the IAB list being included or not?
And could you also elaborate a little more about the way bots are identified in WURFL currently?
I cannot find any precise Information on that..
Thanks!
Thanks.
Re: IAB/ABC International Spiders & Bots List
Hi,
Thank you for reaching out. While I do not have any information about the IAB list being included, I can confirm that the value for is_robot is determined through the data in the WURFL data file as well as heuristics in the WURFL API. Also, do note that a member of our team should be reaching out to you directly to address any further questions or concerns you may have.
Thanks,
Aaron
Thank you for reaching out. While I do not have any information about the IAB list being included, I can confirm that the value for is_robot is determined through the data in the WURFL data file as well as heuristics in the WURFL API. Also, do note that a member of our team should be reaching out to you directly to address any further questions or concerns you may have.
Thanks,
Aaron
Re: IAB/ABC International Spiders & Bots List
Hi,
I wanted to provide you with an update regarding the "IAB/ABC INTERNATIONAL SPIDERS & BOTS LIST". In short, the answer is no.
We derive our logic for detecting bots through our own log analysis.
Hope this helps. Feel free to reach out to us directly at support@scientiamobile.com for any questions or concerns you may have.
Thanks,
Aaron
I wanted to provide you with an update regarding the "IAB/ABC INTERNATIONAL SPIDERS & BOTS LIST". In short, the answer is no.
We derive our logic for detecting bots through our own log analysis.
Hope this helps. Feel free to reach out to us directly at support@scientiamobile.com for any questions or concerns you may have.
Thanks,
Aaron
Who is online
Users browsing this forum: No registered users and 7 guests