What data is filtered or ignored from Parse.ly Analytics and Data Pipeline?
Parse.ly automatically removes all bot and spider traffic using the IAB/ABC International Spiders and Bots List. This list identifies bots using a list of user agents.
If you would like to deactivate bot filtering, please contact firstname.lastname@example.org.Please note that when bot traffic filtering is turned off then bot traffic will appear in both the Data Pipeline and Parse.ly Analytics.
Alternatively, if you would like to include stricter bot exclusion by IP address, please contact email@example.com.
#Top Level Domains and IP Addresses
By default, Parse.ly only accepts traffic from a TLD that matches the Parse.ly Site ID (ie parsely.com). However, customers can either whitelist or blacklist other TLDs.
Parse.ly also maintains a list of IP addresses that should be ignored for every account individually, such as internal traffic.
Any events that are sent from blacklisted TLDs or IPs are ignored by both Data Pipeline and Parse.ly Analytics.
#Incorrectly formatted event data
Parse.ly also removes incorrectly formatted event data such as:
- events with null event_id, action, url, or apikey fields
- heartbeat events with a null engaged_time_inc field
- events with url fields that cannot be parsed as strings
- video events missing the video-metadata required “link” field