As of May 31, 2023, we have updated our Code of Conduct.

Questions tagged [utf-8]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
12 votes
1 answer
6k views

What the difference and usage of encodings UTF-8 and UTF-8-MAC in iconv?

What the difference and usage of encodings UTF-8 and UTF-8-MAC in iconv? I thought it was the difference between \n and \r(MAC OS 9) at first. But I tried iconv -f UTF-8 -t UTF-8-MAC filename > ...
maP1E bluE's user avatar
  • 1,781
7 votes
2 answers
769 views

What's the simplest way to process files with UTF-8 characters in groff on macOS?

I require Polish diacritics, such as ą, ć, ę, etc. Of course, I can always pre-process the file to replace UTF-8 characters with escaped characters but that's not elegant.
Marek Kowalczyk's user avatar
3 votes
1 answer
5k views

Special character codes are displayed in the Terminal for diacritics when connecting to an Ubuntu Server

When I connect to an Ubuntu Server (ssh) and I try to see some text in the Terminal form the remote server, I get character codes instead of the appropriate text with diacritics. for example for a ...
Gabriel Petrovay's user avatar
3 votes
1 answer
1k views

Rsync keeps copying the same file

I have used rsync for many years between linux filesystems without any problem with a very deterministic behavior. Now I try to use it on mac and experience some problem that some files (a small ...
Mathieu Dutour Sikiric's user avatar
2 votes
1 answer
521 views

About converting to UFT8 from a "Simplified Chinese" file having a "garbled" file name

I use Mac with English MacOS interface. I download a file from Chinese website(Simplified Chinese). It is garbled file name. The garbled file name: %E6%B9%96%E5%8D%97IPTV.apk The real file name: ...
jefferyear's user avatar
2 votes
1 answer
235 views

Can't open .html file with UTF-8

how could I change the file encoding using OS X? If I open a file on Windows Notepad I see all the symbols and everything is fine. If I open it using TextEdit or TextWrangler I see only question marks ...
The50's user avatar
  • 123
2 votes
0 answers
468 views

Terminal MacOS emoji support

I was just wondering if anyone knows the emoji support that the Terminal.app has in MacOS? I'm using zsh, and I end up with this when I type it out, I get the following (note I didn't add a space ...
philosopher's user avatar
1 vote
1 answer
235 views

mount not working for utf-8

I've set the locale: $locale LANG="en_GB.UTF-8" LC_COLLATE="en_GB.UTF-8" LC_CTYPE="en_GB.UTF-8" LC_MESSAGES="en_GB.UTF-8" LC_MONETARY="en_GB.UTF-8" LC_NUMERIC="en_GB.UTF-8" LC_TIME="en_GB.UTF-8" ...
Peter Brooks's user avatar
1 vote
1 answer
23 views

Shortcut to open dialog to insert icon

When I google this I can't find it. But sometimes when I'm in the console and I'm fiddling around a certain key combination triggers a dialog to appear. In the dialog you can choose an icon to insert. ...
botenvouwer's user avatar
1 vote
0 answers
118 views

UTF-8 glyphs are too small

I have been setting up my new terminal on both of my MacBooks Pro and I noticed that UTF-8 glyphs are way smaller on one of them. This holds true in every application and I can't find the setting that ...
Thomas Reynaud's user avatar
1 vote
2 answers
867 views

XQuartz, utf-8 and filenames

This is a question in the continuation of this one: UTF8 filenames and shell utilities: the nightmare of utf-8 and filenames is…. How to avoid this confusion with most notably the ls command on ...
dan's user avatar
  • 11.7k
0 votes
2 answers
3k views

Recursively remove all invalid characters from text files in place

I have several thousand text files, some of which contain invalid UTF-8 characters. I want to recursively remove all invalid characters from these files in place. I am aware that many similar ...
pingu's user avatar
  • 229
0 votes
1 answer
443 views

Alternative to iconv encoding utf-8-mac

There used to be support for an encoding option called utf-8-mac with iconv in the Terminal. It's mentioned in this forum several times. I used to use it a lot. Now with the following command (that ...
Oortone's user avatar
  • 11
0 votes
1 answer
300 views

Spacing error in Terminal

Notice the nonexistent space displayed in the first output. I've sent this to Apple as a bug, but is there anything the user (or admin) can do to fix it? Locale is en_US.UTF-8 The worst part of the ...
WGroleau's user avatar
  • 4,160
0 votes
1 answer
743 views

sshd not setting locale

Edit: I should have mentioned in my original question that I was using MacPorts SSH client, as it turned out there were two root causes. See my own answer below. When I SSH into my OSX machine, it's ...
Jim Stewart's user avatar
0 votes
2 answers
647 views

Force open a file with the UTF-8 encoding

I have a file that contains text. The file is not a text file, it is a SQL file. I want to open this file with the UTF-8 encoding in order to copy and paste the texts. So far, I'm trying to do it ...
Colas's user avatar
  • 2,721
0 votes
1 answer
558 views

automator and python script utf-8 output

I wrote a python shell script and it fails in automator workflow : # -*- coding: utf-8 -*- import urllib, json, os, datetime import locale locale.setlocale(locale.LC_ALL, 'fr_FR') url = "http://...
lefakir's user avatar
  • 111
0 votes
0 answers
32 views

MacOS 12.5 file names are created with wrong char

I made a script to rename mp3 files based on the tags, basically it extracts the data like this: sArtist=$(exiftool -s3 -Artist "$sFile") ... sNewName="$sArtist - $sTitle" mv -v &...
goosseno's user avatar
0 votes
0 answers
22 views

Do ID3v2 tags need BOMs?

I've noticed an anomaly in ID3v2 tags created by Music.app.  It doesn't affect usability at all, at least not on my system. But it's odd and might affect how someone else sees the same file. I have ...
WGroleau's user avatar
  • 4,160
0 votes
1 answer
637 views

Inconsistent rendering of UTF-8 in Mail

I recently received this (not the first time) in Mail.app on MacOS 11.4: On Jun 24, 2021, at 10:02, web host <support@web.host> wrote: "Head Geek (伟思ç��)" <webmaster@my.TLD> ...
WGroleau's user avatar
  • 4,160
-1 votes
1 answer
318 views

Pasting UTF-8 into Terminal (zsh) does something weird [closed]

Is there an environmental setting that makes pasting text into Terminal work differently from typing it in directly? I reported this as a bug, but maybe there's some environmental setting.  After the ...
WGroleau's user avatar
  • 4,160