In this paper we propose a probabilistic supervised classification algorithm for LiDAR (Light Detection And Ranging) point clouds. Several object classes (i.e. ground, building and vegetation) can be separated reliably by considering each point's neighbourhood. Based on Conditional Random Fields (CRF) this contextual information can be incorporated into classification process in order to improve results. Since we want to perform a point-wise classification, no primarily segmentation is needed. Therefore, each 3D point is regarded as a graph's node, whereas edges represent links to the nearest neighbours. Both nodes and edges are associated with features and have effect on the classification. We use some features available from full waveform technology such as amplitude, echo width and number of echoes as well as some extracted geometrical features. The aim of the paper is to describe the CRF model set-up for irregular point clouds, present the features used for classification, and to discuss some results. The resulting overall accuracy is about 94 %.