Is player performance quantifiable in paintball?

In a recent comments I was asked to offer an evaluation, or (semi-)educated opinion if you prefer, of one of the Infamous brawlers--which I refused to do. Not because it isn't an interesting or even a perfectly valid question but because I didn't think it would be either prudent (to potentially antagonize or flatter future opponents) or professional (to say anything that might be viewed as lacking respect for a fellow competitor or obviously for public consumption.) I know that may seem kinda lame to some of you but that's where I'm drawing a line.
If we (Paintball) had a more developed media there would be more of that sort of thing being discussed by fans, players & media monkeys. But we don't--and in a lot of ways never did even when you could count paintball magazines into the double digits, or close. (The industry held the purse strings and generally didn't--doesn't--tolerate bad "PR" even, or especially when it was--or is--the truth. Yes, some mags were better than others but they all played the game to one degree or another.) But I'm digressing. (Again.)
If we generalize the original commenter's question we're left with a generic question about how one might evaluate player performance and just what that evaluation entails. This is pertinent because we're closing in on this season's end and teams are either beginning to or have already begun to think about next season. And along with issues of sponsorship and general financing the other big issue is rosters. What are the teams strengths and weaknesses? Will changes need to be made? What if we lose X, Y or Z to another team or school or a job? Ideally roster moves are about improving but as a practical matter they are often also about filling holes and dealing with the unexpected. Whatever the roster consideration is all those decisions revolve around evaluating talent. (There's other equally important factors in my mind but we'll get to those later.) So here we are nearing the end of another season and everybody on a team or running a team is starting to think about their players--and possible future players, evaluating talent and making judgments.
But what criteria do you use in evaluating players? I intend to talk more, perhaps a lot more, about this in the next post but my purpose this time around was to pose the question--and hopefully begin a "discussion" about the process. What do you look for in a player? How do you determine when a player isn't working out? Break it down for me. Is there a difference between determining if a player is sufficiently skilled and deciding if you want that player on your team? Id so, what is it?
It's easy to say so-and-so is a great player. It's a lot harder to offer quantifiable criteria for making such a judgment. Player X is great because ... why?
What criteria do you use in evaluating players?

EDIT ADDED: Think baseball, basketball or football players. With baseball there's a million and one stats that track aspects of performance so that you can easily compare one player to another based on real quantifiable numbers. The same, to a lesser degree, with most all 'professional' sports. So what about paintball? Is evaluating talent strictly a seat of the pants proposition--I know it when I see it--or are there ways of making real distinctions and quantifiable judgments between different players?

I'ma give y'all a couple days to think about it and comment on it and later in the week I'll pick the subject back up. In the meantime tomorrow I'll be posting designs for a VFTD & DPA T-shirt(s) so look for those while you're contemplating the question.