As a community owner and manager you can remove members from your community. To remove a community owner, you must yourself be a community owner (i.e. a manager cannot remove an owner).
Go to Members-tab in your community.
Find the member you'd like to remove and click the Remove-button.