Cookie Support

[domenukk]

It would be great if you could specify cookies that are used for each request in urlgrab.
Maybe even have a session that adds new cookies along the way (for csrf nonces, etc.)

[Haones]

I would also suggest to do it in the same way as httpx or ffuf does.
Replace -user-agent option with -H option where user can supply any header he wants, like:
> urlgrab -url google.com -H 'Cookie: cookie1=a; cookie2=a' -H 'User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:47.0) Gecko/20100101 Firefox/47.0' -H 'Authorization: Bearer ...'

[domenukk]

Setting headers is helpful, however that doesn't give you cookies you collect while surfing, such as csrf tokens