Python中分享几个PyCon视频的摘要、评分与整理方法

感谢

我整理PyCon视频通常用Python写个小脚本，主要做三件事：抓摘要、打评分、存数据库。

先装几个库：

pip install youtube-transcript-api textblob sqlite3

核心代码这么写：

import sqlite3
from youtube_transcript_api import YouTubeTranscriptApi
from textblob import TextBlob

class PyConVideoOrganizer:
    def __init__(self, db_path='pycon_videos.db'):
        self.conn = sqlite3.connect(db_path)
        self.create_table()
    
    def create_table(self):
        cursor = self.conn.cursor()
        cursor.execute('''
            CREATE TABLE IF NOT EXISTS videos (
                id TEXT PRIMARY KEY,
                title TEXT,
                summary TEXT,
                sentiment_score REAL,
                duration INTEGER,
                year INTEGER
            )
        ''')
        self.conn.commit()
    
    def get_transcript(self, video_id):
        """获取视频字幕并生成摘要"""
        try:
            transcript = YouTubeTranscriptApi.get_transcript(video_id)
            full_text = ' '.join([entry['text'] for entry in transcript])
            
            # 简单摘要：取前3句和后2句
            sentences = full_text.split('. ')
            summary = '. '.join(sentences[:3] + sentences[-2:]) if len(sentences) > 5 else full_text
            
            # 情感分析评分
            blob = TextBlob(full_text)
            sentiment = blob.sentiment.polarity  # -1到1的评分
            
            return summary, sentiment
        except Exception as e:
            print(f"获取字幕失败 {video_id}: {e}")
            return None, 0
    
    def add_video(self, video_id, title, duration, year):
        summary, score = self.get_transcript(video_id)
        if summary:
            cursor = self.conn.cursor()
            cursor.execute('''
                INSERT OR REPLACE INTO videos 
                VALUES (?, ?, ?, ?, ?, ?)
            ''', (video_id, title, summary, score, duration, year))
            self.conn.commit()
            print(f"已添加: {title} (评分: {score:.2f})")
    
    def get_top_videos(self, limit=10):
        """按情感评分获取最佳视频"""
        cursor = self.conn.cursor()
        cursor.execute('''
            SELECT title, summary, sentiment_score 
            FROM videos 
            ORDER BY sentiment_score DESC 
            LIMIT ?
        ''', (limit,))
        return cursor.fetchall()

# 使用示例
organizer = PyConVideoOrganizer()

# 添加几个PyCon视频（需要YouTube视频ID）
videos = [
    ("dQw4w9WgXcQ", "Awesome PyTalk 2023", 1800, 2023),
    ("abc123def456", "Python Patterns", 2400, 2022)
]

for vid, title, dur, year in videos:
    organizer.add_video(vid, title, dur, year)

# 获取评分最高的视频
top_videos = organizer.get_top_videos(5)
for title, summary, score in top_videos:
    print(f"\n{title} ({score:.2f})\n{summary[:200]}...")

我的评分标准很简单：用TextBlob分析字幕文本的情感倾向，正分越高说明内容越积极/有趣。存SQLite方便查询，按年份、评分排序都行。

要更精确的话可以加上关键词提取（用sklearn的TF-IDF），或者用spaCy做实体识别来标记视频涉及的技术主题。

一句话建议：自动化处理加简单评分能快速筛选高质量内容。