Power BI Embedded is for use with external facing applications and doesn't require the end user to have a Pro license. (Licensing is handled differently)
REST API - is for internal facing applications to perform the various actions, and requires users to have the licensing appropriate to the level of reports shared.
I think another difference is that Embedded doesn't require authentication against Azure AD, but the other does.