If following your ex on social media is causing unease/ problems than it is peace/ security in your relationship with your partner and within yourself, its probably best to unfollow them and remove them as a follower from your list.