Segmentation of intracranial aneurysms is an important task in medical diagnosis and surgical planning. Volume-based deep learning frameworks have been proposed for this task; however, they are not effective. In this study, we propose a surface-based deep learning framework that achieves higher performance by leveraging human intervention. First, the user semi-automatically generates a surface representation of the principal brain arteries model from time-of-flight magnetic resonance angiography images. The system then samples 3D vessel surface fragments from the entire brain artery model and classifies the surface fragments into those with and without aneurysms using the point-based deep learning network (PointNet++). Next, the system applies surface segmentation (SO-Net) to the surface fragments containing aneurysms. We conduct a head-to-head comparison of segmentation performance by counting voxels between the proposed surface-based framework and existing pixel-based framework, and our framework achieved a much higher dice similarity coefficient score (72%) than the existing one (46%).