adecb0d1a9
The bundled office skills (#68595) read user documents and agent-authored payloads with the locale-default codec: - docx/powerpoint validators/base.py opened OOXML part XML in text mode before handing it to lxml. On Windows (cp1251/GBK) the bytes decode to mojibake that lxml then parses, so validation runs against silently corrupted document text; on locales where the UTF-8 bytes don't decode the validator crashes with UnicodeDecodeError instead of validating. Opening as bytes lets lxml honor the encoding declared in the XML prolog. - The pdf form scripts (fill_fillable_fields, fill_pdf_form_with_annotations, create_validation_image, check_bounding_boxes) read the fields JSON the agent authors — UTF-8 by construction — with the locale codec, so non-ASCII form values (any Cyrillic/CJK/accented input) either crash or get written into the user's PDF as mojibake. The json.dump writers use ensure_ascii=True and were already safe; only the readers needed pinning. Adds a contract test asserting every document/payload reader is locale-independent, plus a live regression test that runs check_bounding_boxes.py on a non-ASCII fields.json under a forced non-UTF-8 locale — it fails without the fix on both POSIX (C locale) and Windows (cp1251 chokes on the 0x98 byte of U+2018).
38 lines
1.2 KiB
Python
38 lines
1.2 KiB
Python
import json
|
|
import sys
|
|
|
|
from PIL import Image, ImageDraw
|
|
|
|
|
|
|
|
|
|
def create_validation_image(page_number, fields_json_path, input_path, output_path):
|
|
with open(fields_json_path, 'r', encoding='utf-8') as f:
|
|
data = json.load(f)
|
|
|
|
img = Image.open(input_path)
|
|
draw = ImageDraw.Draw(img)
|
|
num_boxes = 0
|
|
|
|
for field in data["form_fields"]:
|
|
if field["page_number"] == page_number:
|
|
entry_box = field['entry_bounding_box']
|
|
label_box = field['label_bounding_box']
|
|
draw.rectangle(entry_box, outline='red', width=2)
|
|
draw.rectangle(label_box, outline='blue', width=2)
|
|
num_boxes += 2
|
|
|
|
img.save(output_path)
|
|
print(f"Created validation image at {output_path} with {num_boxes} bounding boxes")
|
|
|
|
|
|
if __name__ == "__main__":
|
|
if len(sys.argv) != 5:
|
|
print("Usage: create_validation_image.py [page number] [fields.json file] [input image path] [output image path]")
|
|
sys.exit(1)
|
|
page_number = int(sys.argv[1])
|
|
fields_json_path = sys.argv[2]
|
|
input_image_path = sys.argv[3]
|
|
output_image_path = sys.argv[4]
|
|
create_validation_image(page_number, fields_json_path, input_image_path, output_image_path)
|