Websites
Websites
Runtime: 2.6s
Share on Facebook or Twitter
On June 9, 2022 at 9:13:59 AM UTC, https://scontent.xx.fbcdn.net/robots.txt was accessible when tested on AS38818 in Mongolia.

Failures

HTTP Experiment
null
DNS Experiment
null
Control
null

DNS Queries

Resolver:
219.128.132.82
Query:
IN A scontent.xx.fbcdn.net
Engine:
system
Name
Class
TTL
Type
DATA
Answer IP Info
@
IN
A
31.13.77.15
AS32934 (Facebook, Inc.)

TCP Connections

31.13.77.15:443: succeeded

HTTP Requests

URL
GET https://scontent.xx.fbcdn.net/robots.txt
Response Headers
Cache-Control:
private, no-cache, no-store, must-revalidate
Content-Type:
text/plain; charset=utf-8
Date:
Thu, 09 Jun 2022 01:47:13 GMT
Document-Policy:
force-load-at-top
Edge-Control:
cache-maxage=86400s
Expires:
Fri, 10 Jun 2022 01:47:13 +0000
Pragma:
no-cache
Strict-Transport-Security:
max-age=31536000; preload; includeSubDomains
Vary:
Accept-Encoding
X-Content-Type-Options:
nosniff
X-Fb-Debug:
yO2/l/4RK2caPXRa1M1OIG2FH6SLc92CjadbpYASSnolMN+DpG9LHNY4LJGwYXzt32cLPCJlVa3HwJTzrbiZ/g==
X-Fb-Rlafr:
0
X-Fb-Trip-Id:
1679558926
X-Frame-Options:
DENY
X-Xss-Protection:
0
Response Body
# Notice: Collection of data on Facebook through automated means is
# prohibited unless you have express written permission from Facebook
# and may only be conducted for the limited purpose contained in said
# permission.
# See: http://www.facebook.com/apps/site_scraping_tos_terms.php

User-agent: Applebot
Disallow: /

User-agent: baiduspider
Disallow: /

User-agent: Bingbot
Disallow: /

User-agent: Googlebot
Disallow: /

User-agent: Googlebot-Image
Disallow: /
Disallow: /map_tile.php
Disallow: /static_map.php

User-agent: ia_archiver
Disallow: /

User-agent: msnbot
Disallow: /

User-agent: Naverbot
Disallow: /

User-agent: Screaming Frog SEO Spider
Disallow: /

User-agent: seznambot
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: teoma
Disallow: /

User-agent: Twitterbot
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: Yeti
Disallow: /

User-agent: Applebot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: baiduspider
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Bingbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Googlebot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: ia_archiver
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: msnbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Naverbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Screaming Frog SEO Spider
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: seznambot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Slurp
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: teoma
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Twitterbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Yandex
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Yeti
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: *
Disallow: /

Resolver

Resolver ASN
AS58543
Resolver IP
219.128.132.82
Resolver Network Name
<unknown>
Measurement UID
20220609091403.843678_MN_webconnectivity_a4c1766581c0f028
Report ID
20220609T091244Z_webconnectivity_MN_38818_n1_RdcLzJBvjGbiRzBQ
Platform
windows
Software Name
ooniprobe-desktop-unattended (3.8.0)
Measurement Engine
ooniprobe-engine (3.8.0)

Raw Measurement Data

Loading…