Skip to content

Avoid redundant URL normalization in request checks - #921

Open
james-yusuke wants to merge 1 commit into
gocolly:masterfrom
james-yusuke:perf-request-hash-normalization
Open

Avoid redundant URL normalization in request checks#921
james-yusuke wants to merge 1 commit into
gocolly:masterfrom
james-yusuke:perf-request-hash-normalization

Conversation

@james-yusuke

Copy link
Copy Markdown

Reuse the already-normalized URL string when computing revisit hashes during request checks and redirects. This avoids reparsing URLs on a hot path while preserving requestHash behavior for callers that pass raw URLs.

Add a benchmark for requestCheck and a regression test to ensure normalized hashes match the existing requestHash behavior.

Reuse the already-normalized URL string when computing revisit hashes
during request checks and redirects. This avoids reparsing URLs on a hot
path while preserving requestHash behavior for callers that pass raw URLs.

Add a benchmark for requestCheck and a regression test to ensure normalized
hashes match the existing requestHash behavior.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant