Sources claim Miller has been struggling with Garner and Affleck's relationship following Affleck's divorce from Jennifer ...