将应用程序切换到Unicode

3 回答

• 0

  您似乎从一个不寻常的编解码器获取字符 .
  csv文件的来源应该能够告诉你他们正在使用什么 .
  但是，您可以像这样从一个编解码器转换到另一个编解码器：

  import csv
  
  with open("organizationTest.txt","rU") as f:
          reader = csv.reader(f)
          for row in reader:
              _, created = Company.objects.get_or_create(
                  Name=row[0].decode('latin-1').encode('utf8'),
                  Site=row[1].decode('latin-1').encode('utf8'),
                  )
  

  我建议你尝试一下 . 如果仍然无效，请联系csv的创建者文件 .

  回复于 2024-05-06T00:41:09+08:00
• 1

  来自Python CSV docs：

  csv模块不直接支持读取和写入Unicode，但除了ASCII NUL字符的某些问题外，它还是8位清除 . 因此，只要您避免使用像UTF-16这样使用NUL的编码，您就可以编写处理编码和解码的函数或类 . 建议使用UTF-8 . 下面的unicode_csv_reader（）是一个包装csv.reader以处理Unicode CSV数据（Unicode字符串列表）的生成器 .

  import csv
  
  def unicode_csv_reader(unicode_csv_data, dialect=csv.excel, **kwargs):
      # csv.py doesn't do Unicode; encode temporarily as UTF-8:
      csv_reader = csv.reader(utf_8_encoder(unicode_csv_data),
                              dialect=dialect, **kwargs)
      for row in csv_reader:
          # decode UTF-8 back to Unicode, cell by cell:
          yield [unicode(cell, 'utf-8') for cell in row]
  
  def utf_8_encoder(unicode_csv_data):
      for line in unicode_csv_data:
          yield line.encode('utf-8')
  
  
  with open("organizationTest.txt","rU") as f:
          reader = unicode_csv_reader(f)
          for row in reader:
              _, created = Company.objects.get_or_create(
                  Name=row[0],
                  Site=row[1],
                  )
  

  回复于 2024-05-06T00:41:09+08:00
• 1

  试试这个：

  import csv
  
  with open("organizationTest.txt","rU") as f:
          reader = csv.reader(f)
          for row in reader:
              _, created = Company.objects.get_or_create(
                  Name=unicode(row[0]),
                  Site=unicode(row[1]),
                  )
  

  回复于 2024-05-06T00:41:09+08:00