I've enabled separate sorting for files and folders, always sort folders by name. Folders which begins with non-alphanumeric characters are shown in the end. E.g.
Folder1
Test Folder
!test
#test
But "!" and "#" precedes alphanumeric characters, so they should be at the top:
!test
#test
Folder1
Test Folder
Is this by design?