it may happen that File Explorer does not display the offline file icons correctly. You can identify an offline file by the overlay that shows an “x” character in the lower-left corner of the ...

You don’t need a third-party app, just the icon files to replace the defaults. If you’re theming your desktop, it won’t feel complete until the taskbar meshes with the rest of the look.