Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • left - video from the camera
  • right - the published video stream as received from the server

Image Modified

Switching renderer to play video stream from camera:

Image Modified

Work with code of the example

To analyze the code, let's take class MediaDevicesActivity.java of the media-devices example version with hash 4ed4c6d77, which can be downloaded with corresponding build 1.0.1.4670.

1. Initialization of the API.

Flashphoner.init() code

For initialization, object Сontext is passed to the init() method.

...

Flashphoner.getMediaDevices(), MediaDeviceList.getAudioList(), MediaDeviceList.getVideoList() code

Code Block
languagejava
themeRDark
mMicSpinner = (LabelledSpinner) findViewById(R.id.microphone);
mMicSpinner.setItemsArray(Flashphoner.getMediaDevices().getAudioList());

mMicLevel = (TextView) findViewById(R.id.microphone_level);

mCameraSpinner = (LabelledSpinner) findViewById(R.id.camera);
mCameraSpinner.setItemsArray(Flashphoner.getMediaDevices().getVideoList());

3. Getting audio and video constraints set by user

AudioConstraints, VideoConstraints code

...

languagejava
themeRDark

...

Video render management

FPSurfaceViewRenderer.setMirror() code

When a video is shown, an image is displayed to FPSurfaceViewRenderer objects:

  • localRender to display video from camera
  • remoteRender to display stream published preview
  • newSurfaceRenderer to demonstrate renderer switching

For those objects, screen position, scaling type and mirroring should be set.

By default, mirror view is set to display video from camera by setMirror(true) method invokation. To display stream published preview and renderer switching object, mirroring is switched off by setMirror(false):

Code Block
languagejava
themeRDark
        remoteRenderLayout.setPosition(0, 0, 100, 100);
        audioConstraints = new AudioConstraints(remoteRender.setScalingType(RendererCommon.ScalingType.SCALE_ASPECT_FIT);
        if (mUseFEC.isChecked()) {remoteRender.setMirror(false);
            audioConstraints.setUseFEC(trueremoteRender.requestLayout();

        }
     localRenderLayout.setPosition(0, 0, 100, 100);
      if  (mUseStereo.isChecked()) {
localRender.setScalingType(RendererCommon.ScalingType.SCALE_ASPECT_FIT);
        localRender.setMirror(true);
        audioConstraintslocalRender.setUseStereorequestLayout(true);

        }switchRenderLayout.setPosition(0, 0, 100, 100);
        if (!mDefaultPublishAudioBitrate.isChecked() && mDefaultPublishAudioBitrate.getText().length() > 0) {
            audioConstraints.setBitrate(Integer.parseInt(mPublishAudioBitrate.getText().toString()))newSurfaceRenderer.setZOrderMediaOverlay(true);
        newSurfaceRenderer.setScalingType(RendererCommon.ScalingType.SCALE_ASPECT_FIT);
        }newSurfaceRenderer.setMirror(true);
    }
    VideoConstraints videoConstraints = null;
    if (mSendVideo.isChecked()) {
        videoConstraints = new VideoConstraints();newSurfaceRenderer.requestLayout();

In this case, when you choose front camera, the image displayed from camera looks normally but is published mirror. When you choose back camera, image from camera looks mirror but is publihed in normal orientation (see application screenshots above).

4. Getting audio and video constraints set by user

AudioConstraints, VideoConstraints code

Code Block
languagejava
themeRDark
@NonNull
private Constraints getConstraints() {
    AudioConstraints audioConstraints   videoConstraints.setCameraId(((MediaDevice) mCameraSpinner.getSpinner().getSelectedItem()).getId())= null;
        if (mCameraFPS.getText().lengthmSendAudio.isChecked() > 0) {
        audioConstraints = new  videoConstraints.setVideoFps(Integer.parseInt(mCameraFPS.getText().toString()))AudioConstraints();
        if (mUseFEC.isChecked()) {
            audioConstraints.setUseFEC(true);
        }
        if (mWidthmUseStereo.getTextisChecked().length() >{
 0 && mHeight.getText().length() > 0) {
            videoConstraints.setResolution(Integer.parseInt(mWidth.getText().toString()),
                    Integer.parseInt(mHeight.getText().toString()))audioConstraints.setUseStereo(true);
        }
        if (!mDefaultPublishVideoBitratemDefaultPublishAudioBitrate.isChecked() && mPublishVideoBitratemDefaultPublishAudioBitrate.getText().length() > 0) {
             videoConstraintsaudioConstraints.setBitrate(Integer.parseInt(mPublishVideoBitratemPublishAudioBitrate.getText().toString()));
        }
    }
    returnVideoConstraints new Constraints(audioConstraints, videoConstraints);
}

4. Local camera and microphone testing

Flashphoner.getLocalMediaAccess() code

This parameters are passed:

  • audio and video constarints set by user
  • local object SurfaceViewRenderer localRenderer to display image from camera
Code Block
languagejava
themeRDark
case TEST_REQUEST_CODE: {videoConstraints = null;
    if (grantResults.length == 0 ||mSendVideo.isChecked()) {
        videoConstraints  grantResults[0] != PackageManager.PERMISSION_GRANTED ||new VideoConstraints();
          grantResults[1] != PackageManager.PERMISSION_GRANTED) {videoConstraints.setCameraId(((MediaDevice) mCameraSpinner.getSpinner().getSelectedItem()).getId());
        Log.i(TAG, "Permission has been denied by user");if (mCameraFPS.getText().length() > 0) {
    } else {
        Flashphoner.getLocalMediaAccess(getConstraints(), localRendervideoConstraints.setVideoFps(Integer.parseInt(mCameraFPS.getText().toString()));
        mTestButton.setText(R.string.action_release);}
        mTestButton.setTag(R.string.action_release);
        mStartButton.setEnabled(false);
if (mWidth.getText().length() > 0 && mHeight.getText().length() > 0) {
         soundMeter = new SoundMeter(); videoConstraints.setResolution(Integer.parseInt(mWidth.getText().toString()),
        soundMeter.start();
        ...
        Log.i(TAG, "Permission has been granted by user");Integer.parseInt(mHeight.getText().toString()));
        }
    }
break;

5. Session creation

Flashphoner.createSession() code

Object SessionOptions with the following parameters is passed to the createSession() method:

  • URL of WCS server
  • SurfaceViewRenderer, which will be used to display video from the camera
  • SurfaceViewRenderer, which will be used to play the published video stream
Code Block
languagejs
themeRDark
SessionOptions sessionOptions = new SessionOptions(url);
sessionOptions.setLocalRenderer(localRender);
sessionOptions.setRemoteRenderer(remoteRender);

/**
  * Session for connection to WCS server is created with method createSession().
  */
session = Flashphoner.createSession(sessionOptions);

6. Connection to the server.

Session.connect(). code

     if (!mDefaultPublishVideoBitrate.isChecked() && mPublishVideoBitrate.getText().length() > 0) {
             videoConstraints.setBitrate(Integer.parseInt(mPublishVideoBitrate.getText().toString()));
        }
    }
    return new Constraints(audioConstraints, videoConstraints);
}

5. Local camera and microphone testing

Flashphoner.getLocalMediaAccess() code

This parameters are passed:

  • audio and video constarints set by user
  • local object SurfaceViewRenderer localRenderer to display image from camera
Code Block
languagejava
themeRDark
session.connect(new Connection());

7. Receiving the event confirming successful connection.

session.onConnected() code

Code Block
languagejava
themeRDark
@Override
public void onConnected(final Connection connection) {
   runOnUiThread(new Runnable() {
       @Override
case TEST_REQUEST_CODE: {
    if (grantResults.length == 0 ||
          grantResults[0] != PackageManager.PERMISSION_GRANTED ||
          grantResults[1] != PackageManager.PERMISSION_GRANTED) {
        Log.i(TAG, "Permission has been denied by user");
    } else {
        Flashphoner.getLocalMediaAccess(getConstraints(), localRender);
        mTestButton.setText(R.string.action_release);
        mTestButton.setTag(R.string.action_release);
        mStartButton.setEnabled(false);
        soundMeter = new SoundMeter();
        soundMeter.start();
        ...
        Log.i(TAG, "Permission has been granted by user");
    }
break;

6. Session creation

Flashphoner.createSession() code

Object SessionOptions with the following parameters is passed to the createSession() method:

  • URL of WCS server
  • SurfaceViewRenderer, which will be used to display video from the camera
  • SurfaceViewRenderer, which will be used to play the published video stream
Code Block
languagejs
themeRDark
SessionOptions sessionOptions = new SessionOptions(url);
sessionOptions.setLocalRenderer(localRender);
sessionOptions.setRemoteRenderer(remoteRender);

/**
  * Session for connection to WCS server is created with method createSession().
  */
session = Flashphoner.createSession(sessionOptions);

7. Connection to the server.

Session.connect(). code

Code Block
languagejava
themeRDark
session.connect(new Connection());

8. Receiving the event confirming successful connection.

session.onConnected() code

Code Block
languagejava
themeRDark
@Override
public void onConnected(final Connection connection) {
   runOnUiThread(new Runnable() {
       @Override
       public void run() {
           mStartButton.setText(R.string.action_stop);
           mStartButton.setTag(R.string.action_stop);
           mStartButton.setEnabled(true);
           mTestButton.setEnabled(false);
           mStatusView.setText(connection.getStatus());;
           ...
       }
   });
}

9. Video stream creation

session.createStream() code

Code Block
languagejava
themeRDark
publishStream = session.createStream(streamOptions);
if (mMuteAudio.isChecked()) {
    publishStream.muteAudio();
}
if (mMuteVideo.isChecked()) {
    publishStream.muteVideo();
}
...

ActivityCompat.requestPermissions(MediaDevicesActivity.this,
         new String[]{Manifest.permission.RECORD_AUDIO, Manifest.permission.CAMERA},
         PUBLISH_REQUEST_CODE);

10. Video stream publishing.

Stream.publish() code

Code Block
languagejava
themeRDark
case PUBLISH_REQUEST_CODE: {
    if (grantResults.length == 0 ||
           grantResults[0] != PackageManager.PERMISSION_GRANTED ||
           grantResults[1] != PackageManager.PERMISSION_GRANTED) {
        mStartButton.setEnabled(false);
        mTestButton.setEnabled(false);
        session.disconnect();
        Log.i(TAG, "Permission has been denied by user");
    } else {
        /**
          * Method Stream.publish() is called to publish stream.
          */
        publishStream.publish();
        Log.i(TAG, "Permission has been granted by user");
    }
    break;
}

11. Receiving the event confirming successful stream publishing

StreamStatusEvent PUBLISHING code

On receiving this event preview stream is created with Session.createStream() and Stream.play() is invoked to play it.

Code Block
languagejava
themeRDark
publishStream.on(new StreamStatusEvent() {
    @Override
    public void onStreamStatus(final Stream stream, final StreamStatus streamStatus) {
        runOnUiThread(new Runnable() {
            @Override
            public void run() {
                if (StreamStatus.PUBLISHING.equals(streamStatus)) {
                    /**
                      * The options for the stream to play are set.
                      * The stream name is passed when StreamOptions object is created.
        public void run() {
           mStartButton.setText(R.string.action_stop);*/
           mStartButton.setTag(R.string.action_stop);
         StreamOptions streamOptions = new mStartButton.setEnabledStreamOptions(truestreamName);

           mTestButton.setEnabled(false);
           mStatusView.setText(connection.getStatus(streamOptions.setConstraints(new Constraints(mReceiveAudio.isChecked(), mReceiveVideo.isChecked()));;

           ...
       }
   });
}

8. Video stream creation

session.createStream() code

Code Block
languagejava
themeRDark
publishStream = session.createStream(streamOptions);
if (mMuteAudio.isChecked()) {
    publishStream.muteAudio();
}
if (mMuteVideo.isChecked()) {
    publishStream.muteVideo();
}
...

ActivityCompat.requestPermissions(MediaDevicesActivity.this,   VideoConstraints videoConstraints = null;
                    if (mReceiveVideo.isChecked()) {
         new String[]{Manifest.permission.RECORD_AUDIO, Manifest.permission.CAMERA},
               videoConstraints =  PUBLISH_REQUEST_CODE);

9. Video stream publishing.

Stream.publish() code

Code Block
languagejava
themeRDark
case PUBLISH_REQUEST_CODE: {
new VideoConstraints();
       if (grantResults.length == 0 ||
           grantResults[0] != PackageManager.PERMISSION_GRANTED ||
...
                 grantResults[1] != PackageManager.PERMISSION_GRANTED) { }
        mStartButton.setEnabled(false);
        mTestButton.setEnabled(false);
     AudioConstraints audioConstraints = session.disconnect()null;
        Log.i(TAG, "Permission has been denied by user");
            } elseif (mReceiveAudio.isChecked()) {
        /**
          * Method Stream.publish() is called to publishaudioConstraints stream.
= new AudioConstraints();
        */
        publishStream.publish();
    }
    Log.i(TAG, "Permission has been granted by user");
    }
    break;
}

10. Receiving the event confirming successful stream publishing

StreamStatusEvent PUBLISHING code

On receiving this event preview stream is created with Session.createStream() and Stream.play() is invoked to play it.

Code Block
languagejava
themeRDark
publishStream.on(new StreamStatusEvent() {  streamOptions.setConstraints(new Constraints(audioConstraints, videoConstraints));
    @Override
    public void onStreamStatus(final Stream stream, final StreamStatus streamStatus) {
    String[] stripCodec =  runOnUiThread(new Runnable() {
{(String) mStripPlayerCodec.getSpinner().getSelectedItem()};
                    @OverridestreamOptions.setStripCodecs(stripCodec);
            public void run() {
     /**
           if (StreamStatus.PUBLISHING.equals(streamStatus)) {
         * Stream is created with       /**method Session.createStream().
                      */
 The  options for the stream to play are set.
          playStream = session.createStream(streamOptions);
          * The stream name is passed when StreamOptions object is created...
                      /**/
                    StreamOptions streamOptions =* newMethod StreamOptionsStream.play(streamName);
) is called to start playback of the stream.
                    streamOptions.setConstraints(new Constraints(mReceiveAudio.isChecked(), mReceiveVideo.isChecked()));
 */
                    VideoConstraints videoConstraints = nullplayStream.play();
                    if (mReceiveVideomSendVideo.isChecked()) {
                        videoConstraints = new VideoConstraints(mSwitchCameraButton.setEnabled(true);
                    mSwitchRendererButton.setEnabled(true);
               ...
} else {
                  }
              Log.e(TAG, "Can not publish stream " + stream.getName() + " " + streamStatus);
       AudioConstraints audioConstraints = null;
     }
               if (mReceiveAudio.isCheckedmStatusView.setText(streamStatus.toString()) {;
           }
             audioConstraints = new AudioConstraints(});
             }
});

12. Switching camera while publishing stream

Stream.switchCamera() code

Code Block
languagejava
themeRDark
mSwitchCameraButton.setOnClickListener(new OnClickListener() {
       }@Override
    public void onClick(View view) {
            streamOptions.setConstraints(new Constraints(audioConstraints, videoConstraints));if (publishStream != null) {
                    String[] stripCodec = {(String) mStripPlayerCodec.getSpinner().getSelectedItem()}mSwitchCameraButton.setEnabled(false);
            publishStream.switchCamera(new CameraSwitchHandler() {
      streamOptions.setStripCodecs(stripCodec);
          @Override
          /**
      public void onCameraSwitchDone(boolean var1) {
            * Stream is created with method Session.createStream().
  runOnUiThread(new Runnable() {
                  */
       @Override
             playStream = session.createStream(streamOptions);
         public void run() {
        ...
                    /**mSwitchCameraButton.setEnabled(true);
                      * Method Stream.play() is called to start playback of the stream.
 }
                    });

         */
       }

             playStream.play();
   @Override
                public ifvoid (mSendVideo.isChecked())
   onCameraSwitchError(String var1) {
                     mSwitchCameraButton.setEnabled(true);runOnUiThread(new Runnable() {
                    mSwitchRendererButton.setEnabled(true);
     @Override
          } else {
            public void run() {
    Log.e(TAG, "Can not publish stream " + stream.getName() + " " + streamStatus);
               }mSwitchCameraButton.setEnabled(true);
               mStatusView.setText(streamStatus.toString());
           }
       });
    }
});

11. Switching camera while publishing stream

Stream.switchCamera() code

Code Block
languagejava
themeRDark
mSwitchCameraButton.setOnClickListener(new OnClickListener() {
    @Override
    public});
 void onClick(View view) {
        if (publishStream != null) {}
            mSwitchCameraButton.setEnabled(false});
        }
    publishStream.switchCamera(new CameraSwitchHandler() {
            }

});

13. Switching renderer object while publishing stream

Stream.switchRenderer() code

Code Block
languagejava
themeRDark
mSwitchRendererButton.setOnClickListener(new OnClickListener() {
    @Override
                public void onCameraSwitchDoneonClick(booleanView var1v) {
                    runOnUiThread(new Runnableif (spinner.getSelectedItemId() == 0){
            if (isSwitchRemoteRenderer) {
          @Override
         playStream.switchRenderer(remoteRender);
               public void run() {
  isSwitchRemoteRenderer = false;
            }
            mSwitchCameraButton.setEnabled(true);if (!isSwitchLocalRenderer) {
                publishStream.switchRenderer(newSurfaceRenderer);
        }
        isSwitchLocalRenderer = true;
          });

  } else {
            }

    publishStream.switchRenderer(localRender);
            @Override
    isSwitchLocalRenderer = false;
          public void onCameraSwitchError(String var1) {
}
        } else {
            runOnUiThread(newif Runnable(isSwitchLocalRenderer) {
                publishStream.switchRenderer(localRender);
        @Override
        isSwitchLocalRenderer = false;
            }
  public void run() {
       if (!isSwitchRemoteRenderer) {
                   mSwitchCameraButton.setEnabled(trueplayStream.switchRenderer(newSurfaceRenderer);
                isSwitchRemoteRenderer = true;
      }
      } else {
                }playStream.switchRenderer(remoteRender);
                isSwitchRemoteRenderer = }false;
            });
        }
    }

});

12. Switching renderer object while publishing stream

Stream.switchRenderer() 14. Sound volume changing with hardware buttons

Flashphoner.setVolume() code

Code Block
languagejava
themeRDark
mSwitchRendererButton.setOnClickListener(new OnClickListener() {    @Override
    public boolean onKeyDown(int keyCode, KeyEvent event) {
        int currentVolume = Flashphoner.getVolume();
    @Override
    public voidswitch onClick(View vkeyCode) {
        if (spinner.getSelectedItemId() == 0){
    case KeyEvent.KEYCODE_VOLUME_DOWN:
                if (isSwitchRemoteRenderercurrentVolume == 1) {
                playStream.switchRenderer(remoteRender    Flashphoner.setVolume(0);
                isSwitchRemoteRenderer = false;
         }
   }
            if (!isSwitchLocalRenderer) {mPlayVolume.setProgress(currentVolume-1);
                publishStream.switchRenderer(newSurfaceRenderer)break;
            case KeyEvent.KEYCODE_VOLUME_UP:
    isSwitchLocalRenderer = true;
          if (currentVolume }== else0) {
                publishStream.switchRenderer(localRender    Flashphoner.setVolume(1);
                isSwitchLocalRenderer = false;
  }
          }
      mPlayVolume.setProgress(currentVolume+1);
  } else {
            if (isSwitchLocalRenderer) {
break;
        }
        return  publishStreamsuper.switchRenderer(localRenderonKeyDown(keyCode, event);
        }

15. Device speakerphone usage

Flashphoner.getAudioManager().isSpeakerphoneOn(), Flashphoner.getAudioManager().setUseSpeakerPhone() code

Code Block
languagejava
themeRDark
        isSwitchLocalRenderermSpeakerPhone = false (CheckBox) findViewById(R.id.use_speakerphone);
            }
            if (!isSwitchRemoteRenderer) {
                playStream.switchRenderer(newSurfaceRenderermSpeakerPhone.setChecked(Flashphoner.getAudioManager().getAudioManager().isSpeakerphoneOn());
        mSpeakerPhone.setOnCheckedChangeListener(new        isSwitchRemoteRenderer = true;CompoundButton.OnCheckedChangeListener() {
            }@Override
 else {
          public void onCheckedChanged(CompoundButton buttonView, boolean  playStream.switchRenderer(remoteRender);isChecked) {
                isSwitchRemoteRenderer = falseFlashphoner.getAudioManager().setUseSpeakerPhone(isChecked);
            }
        }
    }
});

1316. Session disconnection.

Session.disconnect() code

Code Block
languagejava
themeRDark
mStartButton.setEnabled(false);

/**
  * Connection to WCS server is closed with method Session.disconnect().
  */
session.disconnect();

1417. Receiving the event confirming successful disconnection

session.onDisconnection() code

Code Block
languagejava
themeRDark
@Override
public void onDisconnection(final Connection connection) {
    runOnUiThread(new Runnable() {
       @Override
       public void run() {
           mStartButton.setText(R.string.action_start);
           mStartButton.setTag(R.string.action_start);
           mStartButton.setEnabled(true);
           mSwitchCameraButton.setEnabled(false);
           mSwitchRendererButton.setEnabled(false);
           mStatusView.setText(connection.getStatus());
           mTestButton.setEnabled(true);
      }
   });
}