Websites
Websites
Runtime: 3s
Share on Facebook or Twitter
On August 19, 2022 at 8:30:01 PM UTC, https://scontent.xx.fbcdn.net/robots.txt was accessible when tested on AS29049 in Azerbaijan.

Failures

HTTP Experiment
null
DNS Experiment
null
Control
null

DNS Queries

Resolver:
[scrubbed]
Query:
IN A scontent.xx.fbcdn.net
Engine:
system
Name
Class
TTL
Type
DATA
Answer IP Info
@
IN
A
157.240.234.1
AS32934 (Facebook, Inc.)

TCP Connections

157.240.234.1:443: succeeded

HTTP Requests

URL
GET https://scontent.xx.fbcdn.net/robots.txt
Response Headers
Cache-Control:
private, no-cache, no-store, must-revalidate
Content-Type:
text/plain; charset=utf-8
Date:
Fri, 19 Aug 2022 08:02:33 GMT
Document-Policy:
force-load-at-top
Edge-Control:
cache-maxage=86400s
Expires:
Sat, 20 Aug 2022 08:02:33 +0000
Pragma:
no-cache
Strict-Transport-Security:
max-age=31536000; preload; includeSubDomains
Vary:
Accept-Encoding
X-Content-Type-Options:
nosniff
X-Fb-Debug:
g50UqATyQBqecsJ/4sR/ekvrT1AZwZ24PlCZDq8xko6vSxT/wtKa+REVs72qirgWlrn5+RDFesykFheNLWYv9g==
X-Fb-Rlafr:
0
X-Fb-Trip-Id:
1460883810
X-Frame-Options:
DENY
X-Xss-Protection:
0
Response Body
# Notice: Collection of data on Facebook through automated means is
# prohibited unless you have express written permission from Facebook
# and may only be conducted for the limited purpose contained in said
# permission.
# See: http://www.facebook.com/apps/site_scraping_tos_terms.php

User-agent: Applebot
Disallow: /

User-agent: baiduspider
Disallow: /

User-agent: Bingbot
Disallow: /

User-agent: Googlebot
Disallow: /

User-agent: Googlebot-Image
Disallow: /
Disallow: /map_tile.php
Disallow: /static_map.php

User-agent: ia_archiver
Disallow: /

User-agent: msnbot
Disallow: /

User-agent: Naverbot
Disallow: /

User-agent: Screaming Frog SEO Spider
Disallow: /

User-agent: seznambot
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: teoma
Disallow: /

User-agent: Twitterbot
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: Yeti
Disallow: /

User-agent: Applebot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: baiduspider
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Bingbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Googlebot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: ia_archiver
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: msnbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Naverbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Screaming Frog SEO Spider
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: seznambot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Slurp
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: teoma
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Twitterbot
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Yandex
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: Yeti
Allow: /map_tile.php
Allow: /security/hsts-pixel.gif
Allow: /static_map.php

User-agent: *
Disallow: /

Resolver

Resolver ASN
AS29049
Resolver IP
62.212.239.20
Resolver Network Name
Delta Telecom Ltd
Measurement UID
20220819203001.529916_AZ_webconnectivity_62f2a92de9556cdb
Report ID
20220819T202631Z_webconnectivity_AZ_29049_n1_oHUBlWbFAMo6uUzQ
Platform
windows
Software Name
ooniprobe-desktop-unattended (3.14.1)
Measurement Engine
ooniprobe-engine (3.14.1)

Raw Measurement Data

Loading…