Is it possible to add a custom icon to the icon picker from Resource Files?
Unfortunately not, but you might add these icons as images to the Files section in Create, and then use them either in the Image UI Component or as background images on containers.
Is this an upcoming feature?
Not in the short term. Since it has an alternative solution (using images), and is no quickfix, it’s not on top of the priority list currently.