Fix parser regression

Added exception catch for TypeErrors due to future addition of keys, allowing Sherlock to continue past those errors. Removed $schema to accomodate older versions of the parser. This key will be added back in sherlock-project#2088 (or other version incrementing change).
ppfeister · May 8, 2024 · 78d255e · 78d255e
1 parent d0c8282
commit 78d255e
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 1 deletion.
diff --git a/sherlock/resources/data.json b/sherlock/resources/data.json
@@ -1,5 +1,4 @@
 {
-  "$schema": "data.schema.json",
   "1337x": {
     "errorMsg": [
       "<title>Error something went wrong.</title>",

diff --git a/sherlock/sites.py b/sherlock/sites.py
@@ -177,6 +177,8 @@ def __init__(self, data_file_path=None):
                 raise ValueError(
                     f"Problem parsing json contents at '{data_file_path}':  Missing attribute {error}."
                 )
+            except TypeError as error:
+                print(f"Encountered TypeError parsing json contents for target '{site_name}' at {data_file_path}\nSkipping target.\n")
 
         return