This special new function for CapsLock does not seem to be very well documented by Apple–which should not come as a surprise to anyone who's been using their products for very long. Therefore, we don't seem to have been given the information needed to fully utilize or understand that feature.
So, basically, to answer your question: No, that does not seem to possible at this time.
However, there is a fairly simple work-around that can come close to duplicating that feature although there are some minor discrepancies which for me personally are actually preferable to the way the original feature was designed to work–although your preferences & priorities may obviously vary.
In any case, you could create a single custom keyboard based on the US keyboard that has the appropriate Ukrainian layout programmed directly into the CapsLock-based modifier combinations (keyboard layers or shift levels).
Mac OSX essentially treats CapsLock as a regular, but locking, modifier key without any limitations. So, with Ukelele you may create a layout which supports both Latin & Cyrillic scripts and uses CapsLock to switch between them.
The Latin-based modifier combinations can mostly (if not entirely) be created automatically in several ways (the easiest being to duplicate the US keyboard you use, or create a layout that mirrors the currently active layout).
For the Cyrillic-based Ukrainian layers you can open a keyboard you wish to emulate (or approximate) and drag the key mappings from that keyboard to you yours (with the proper CapsLock-based modifier combination activated).
I don't think that a little bit of manual labor can be avoided, but you can accomplish your objective natively in this way. There are some potential advantages & disadvantages to this option depending on your preferences.
For example, the flag will not change from US to Ukrainian which may be seen as a disadvantage. However, you will have the CapsLock LED as an indication which may be seen as an advantage. This also circumvents having to change the keyboard layout which is sometimes necessary when switching apps or documents, as well as the slight delay involved with that–that is of particular value to me as it drives me crazy when the keyboard layout is potentially different in each app.
If not for the OP, I hope this is informative or helpful to someone.
