The solution to this can be found by googling, but I've repeatedly struggled to track it down, so here it is for future reference:
- At the Firefox address bar, enter about:config and filter for network.automatic-ntlm-auth.trusted-uris. Select the setting and enter the domain name in question, e.g. my-sharepoint.
- Restart Firefox and you should not longer be prompted for your Windows credentials.