Handle query argument type of link style like"?post=xxx"

[ChengduLittleA]

Hi there administrators!
My blog in the webring uses a link format of index.php?post=20220612001238, like this, however it looks to me that the crawler doesn't like query arguments in the url:

lieu/crawler/crawler.go

Line 51 in b0ad7dc

if strings.Contains(target, "?") {

Can there be a way for sites to hint that they may want to use ? or # separated URLs? From what I know, MDWiki is quite popular and it uses #! to specify page links, so that way we could index more pages for these sites as well.

I can see where # could post some problems with title links... I'd suggest that allow a <meta> or some sort of tag in the page head to hint the crawler that some formats of the link can be allowed, and if href regex matches the "allowed link format", the link will be preserved?

Thanks!