如何Parse URLs
Break URL 为其 components: 协议, 主机, 端口, 路径, 查询, 和片段.
问题
你需要提取特定 parts 的 URL, 如 hostname 或查询 parameters.
前置条件
- Understanding 的 URL 结构
- 熟悉URL components
步骤
-
1. Understand URL components
A URL consists of a scheme (protocol), authority (userinfo@host:port), path, query string, and fragment. Each part is optional in certain contexts. The standard URL format is defined in RFC 3986.
输入https://[email protected]:8080/path?q=1#frag输出scheme: https, host: example.com, port: 8080, path: /path, query: q=1, fragment: frag -
2. Parse the URL
Use a URL parser rather than splitting on characters. A parser correctly handles edge cases like IPv6 addresses in brackets, encoded characters, and missing components. The WHATWG URL API is the modern standard.
输入https://example.com/path?q=1输出parsed components -
3. Extract and use components
Access the specific components you need: hostname for DNS lookups, pathname for routing, searchParams for query values. Parse query parameters into a key-value map. Handle missing components gracefully.
输入searchParams: q=1&page=2输出{q: '1', page: '2'}
预期结果
URL decomposed 为其 individual components, 就绪为 inspection 或 use.
常见错误
- Splitting on ':' or '/' instead of using a parser
- Use a proper URL parser. Naive splitting fails on IPv6 addresses, encoded slashes, and missing components.
- Query parameters not decoded
- URL-decode query parameter values after parsing. %20 should become a space, %26 should become &.
排障指引
- If parsing fails, the URL may be malformed or relative. Use a base URL to resolve relative URLs.
- IPv6 addresses must be in brackets: http://[::1]:8080/.
安全限制
- Parsed URLs may point to malicious hosts. Validate the scheme and host before making requests. Be aware of open redirect vulnerabilities.