Confession

So I am a Christian non-denominational but when I go see my parents we attend Sunday mass. I grew up Catholic. I believe confession is between me and God. Confession to a priest isn’t necessary. I find it to be like the middle man. However today at mass I thought well what’s the harm? I know no. Catholic Christians or most don’t believe to confessing to a priest but I don’t see the harm? I haven’t done it in over 10 years. I confess to God directly about my sins and will continue to do so. So what are other people’s opinions on this?