Using your fork, knife, or spoon to point at a person is absolutely considered rude. Gesturing with utensils likewise (because you can shower others with cast off detritus.)

A quick Google search will turn up hundreds of results corroborating this.