Intravascular Optical Coherence Tomography (IVOCT) is a modality which gives in vivo insight of coronaries’ artery morphology. Thus, it helps diagnosis and prevention of atherosclerosis. About 100–300 cross-sectional OCT images are obtained for each artery. Therefore, it is important to facilitate and objectify the process of detecting regions of interest, which otherwise demand a lot of time and effort from medical experts. We propose a processing pipeline to automatically detect parts of the arterial wall which are not normal and possibly consist of plaque. The first step of the processing is transforming OCT images to polar coordinates and to detect the arterial wall. After binarization of the image and removal of the catheter, the arterial wall is detected in each axial line from the first white pixel to a depth of 80 pixels which is equal to 1.5 mm. Then, the arterial wall is split to orthogonal patches which undergo OCT-specific transformations and are labelled as plaque (4 distinct kinds: fibrous, calcified, lipid and mixed) or normal tissue. OCT-specific transformations include enhancing the more reflective parts of the image and rendering patches independent of the arterial wall curvature. The patches are input to AlexNet which is fine-tuned to learn to classify them. Fine-tuning is performed by retraining an already trained AlexNet with a learning rate which is 20 times larger for the last 3 fully-connected layers than for the initial 5 convolutional layers. 114 cross-sectional images were randomly selected to fine-tune AlexNet while 6 were selected to validate the results. Training accuracy was 100% while validation accuracy was 86%. Drop in validation accuracy rate is attributed mainly to false negatives which concern only calcified plaque. Thus, there is potential in this method especially in detecting the 3 other classes of plaque.